2023-11-18 20:53:16,736 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-18 20:53:16,977 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec 2023-11-18 20:53:16,991 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-18 20:53:16,992 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261, deleteOnExit=true 2023-11-18 20:53:16,992 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-18 20:53:16,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/test.cache.data in system properties and HBase conf 2023-11-18 20:53:16,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/hadoop.tmp.dir in system properties and HBase conf 2023-11-18 20:53:16,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/hadoop.log.dir in system properties and HBase conf 2023-11-18 20:53:16,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-18 20:53:16,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-18 20:53:16,995 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-18 20:53:17,117 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-18 20:53:17,527 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-18 20:53:17,532 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-18 20:53:17,532 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-18 20:53:17,533 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-18 20:53:17,533 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-18 20:53:17,533 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-18 20:53:17,534 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-18 20:53:17,534 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-18 20:53:17,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-18 20:53:17,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-18 20:53:17,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/nfs.dump.dir in system properties and HBase conf 2023-11-18 20:53:17,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/java.io.tmpdir in system properties and HBase conf 2023-11-18 20:53:17,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-18 20:53:17,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-18 20:53:17,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-18 20:53:18,173 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-18 20:53:18,179 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-18 20:53:18,479 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-18 20:53:18,641 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-18 20:53:18,656 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-18 20:53:18,694 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-18 20:53:18,727 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/java.io.tmpdir/Jetty_localhost_38833_hdfs____dfpmt9/webapp 2023-11-18 20:53:18,866 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38833 2023-11-18 20:53:18,877 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-18 20:53:18,877 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-18 20:53:19,437 WARN [Listener at localhost/41799] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-18 20:53:19,521 WARN [Listener at localhost/41799] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-18 20:53:19,539 WARN [Listener at localhost/41799] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-18 20:53:19,546 INFO [Listener at localhost/41799] log.Slf4jLog(67): jetty-6.1.26 2023-11-18 20:53:19,550 INFO [Listener at localhost/41799] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/java.io.tmpdir/Jetty_localhost_34617_datanode____.6s3a9q/webapp 2023-11-18 20:53:19,653 INFO [Listener at localhost/41799] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34617 2023-11-18 20:53:20,035 WARN [Listener at localhost/41997] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-18 20:53:20,608 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8be221a86a3fcf37: Processing first storage report for DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c from datanode 0aa0e251-94b9-402c-97e6-75e64db04731 2023-11-18 20:53:20,609 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8be221a86a3fcf37: from storage DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c node DatanodeRegistration(127.0.0.1:45853, datanodeUuid=0aa0e251-94b9-402c-97e6-75e64db04731, infoPort=38673, infoSecurePort=0, ipcPort=41997, storageInfo=lv=-57;cid=testClusterID;nsid=817852409;c=1700340798252), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-18 20:53:20,610 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8be221a86a3fcf37: Processing first storage report for DS-4f6936a7-aab1-479e-b656-1b8051053526 from datanode 0aa0e251-94b9-402c-97e6-75e64db04731 2023-11-18 20:53:20,610 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8be221a86a3fcf37: from storage DS-4f6936a7-aab1-479e-b656-1b8051053526 node DatanodeRegistration(127.0.0.1:45853, datanodeUuid=0aa0e251-94b9-402c-97e6-75e64db04731, infoPort=38673, infoSecurePort=0, ipcPort=41997, storageInfo=lv=-57;cid=testClusterID;nsid=817852409;c=1700340798252), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-18 20:53:20,690 DEBUG [Listener at localhost/41997] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec 2023-11-18 20:53:20,802 INFO [Listener at localhost/41997] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/zookeeper_0, clientPort=55479, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-18 20:53:20,819 INFO [Listener at localhost/41997] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55479 2023-11-18 20:53:20,827 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:20,829 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:21,505 INFO [Listener at localhost/41997] util.FSUtils(471): Created version file at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e with version=8 2023-11-18 20:53:21,505 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/hbase-staging 2023-11-18 20:53:21,829 INFO [Listener at localhost/41997] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-18 20:53:22,336 INFO [Listener at localhost/41997] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-18 20:53:22,371 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,371 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,372 INFO [Listener at localhost/41997] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-18 20:53:22,372 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,372 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-18 20:53:22,520 INFO [Listener at localhost/41997] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-18 20:53:22,595 DEBUG [Listener at localhost/41997] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-18 20:53:22,697 INFO [Listener at localhost/41997] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44653 2023-11-18 20:53:22,707 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:22,709 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:22,732 INFO [Listener at localhost/41997] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44653 connecting to ZooKeeper ensemble=127.0.0.1:55479 2023-11-18 20:53:22,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:446530x0, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-18 20:53:22,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44653-0x1000245812a0000 connected 2023-11-18 20:53:22,807 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 20:53:22,808 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 20:53:22,811 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-18 20:53:22,819 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44653 2023-11-18 20:53:22,820 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44653 2023-11-18 20:53:22,820 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44653 2023-11-18 20:53:22,821 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44653 2023-11-18 20:53:22,821 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44653 2023-11-18 20:53:22,827 INFO [Listener at localhost/41997] master.HMaster(444): hbase.rootdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e, hbase.cluster.distributed=false 2023-11-18 20:53:22,898 INFO [Listener at localhost/41997] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-18 20:53:22,898 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,898 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,898 INFO [Listener at localhost/41997] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-18 20:53:22,899 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-18 20:53:22,899 INFO [Listener at localhost/41997] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-18 20:53:22,904 INFO [Listener at localhost/41997] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-18 20:53:22,907 INFO [Listener at localhost/41997] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32871 2023-11-18 20:53:22,909 INFO [Listener at localhost/41997] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-18 20:53:22,915 DEBUG [Listener at localhost/41997] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-18 20:53:22,916 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:22,918 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:22,920 INFO [Listener at localhost/41997] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32871 connecting to ZooKeeper ensemble=127.0.0.1:55479 2023-11-18 20:53:22,926 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:328710x0, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-18 20:53:22,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32871-0x1000245812a0001 connected 2023-11-18 20:53:22,927 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 20:53:22,928 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 20:53:22,929 DEBUG [Listener at localhost/41997] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-18 20:53:22,932 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32871 2023-11-18 20:53:22,932 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32871 2023-11-18 20:53:22,933 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32871 2023-11-18 20:53:22,933 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32871 2023-11-18 20:53:22,934 DEBUG [Listener at localhost/41997] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32871 2023-11-18 20:53:22,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:22,946 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-18 20:53:22,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:22,969 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-18 20:53:22,969 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-18 20:53:22,969 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:22,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-18 20:53:22,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44653,1700340801652 from backup master directory 2023-11-18 20:53:22,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-18 20:53:22,975 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:22,975 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-18 20:53:22,976 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-18 20:53:22,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:22,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-18 20:53:22,980 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-18 20:53:23,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/hbase.id with ID: 9e235f31-1b17-473e-8b21-37b8bdc4182e 2023-11-18 20:53:23,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:23,125 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:23,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78df465a to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:23,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5466ef5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:23,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-18 20:53:23,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-18 20:53:23,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-18 20:53:23,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-18 20:53:23,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-18 20:53:23,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-18 20:53:23,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 20:53:23,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store-tmp 2023-11-18 20:53:23,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:23,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-18 20:53:23,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:53:23,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:53:23,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-18 20:53:23,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:53:23,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:53:23,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 20:53:23,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/WALs/jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:23,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44653%2C1700340801652, suffix=, logDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/WALs/jenkins-hbase4.apache.org,44653,1700340801652, archiveDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/oldWALs, maxLogs=10 2023-11-18 20:53:23,813 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK] 2023-11-18 20:53:23,824 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-18 20:53:23,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/WALs/jenkins-hbase4.apache.org,44653,1700340801652/jenkins-hbase4.apache.org%2C44653%2C1700340801652.1700340803754 2023-11-18 20:53:23,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK]] 2023-11-18 20:53:23,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:23,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:23,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:23,901 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:23,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:23,965 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-18 20:53:23,997 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-18 20:53:24,012 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:24,019 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:24,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:24,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-18 20:53:24,046 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:24,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72239409, jitterRate=0.07645107805728912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:24,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 20:53:24,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-18 20:53:24,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-18 20:53:24,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-18 20:53:24,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-18 20:53:24,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-18 20:53:24,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-11-18 20:53:24,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-18 20:53:24,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-18 20:53:24,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-18 20:53:24,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-18 20:53:24,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-18 20:53:24,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-18 20:53:24,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-18 20:53:24,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-18 20:53:24,203 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:24,205 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-18 20:53:24,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-18 20:53:24,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-18 20:53:24,231 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-18 20:53:24,231 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:24,232 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-18 20:53:24,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,44653,1700340801652, sessionid=0x1000245812a0000, setting cluster-up flag (Was=false) 2023-11-18 20:53:24,255 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:24,269 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-18 20:53:24,271 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:24,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:24,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-18 20:53:24,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:24,291 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp 2023-11-18 20:53:24,339 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(951): ClusterId : 9e235f31-1b17-473e-8b21-37b8bdc4182e 2023-11-18 20:53:24,346 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-18 20:53:24,354 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-18 20:53:24,354 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-18 20:53:24,358 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-18 20:53:24,361 DEBUG [RS:0;jenkins-hbase4:32871] zookeeper.ReadOnlyZKClient(139): Connect 0x2666dfa2 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:24,368 DEBUG [RS:0;jenkins-hbase4:32871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28a1251e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:24,369 DEBUG [RS:0;jenkins-hbase4:32871] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c9eb4d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-18 20:53:24,401 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32871 2023-11-18 20:53:24,406 INFO [RS:0;jenkins-hbase4:32871] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-18 20:53:24,406 INFO [RS:0;jenkins-hbase4:32871] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-18 20:53:24,406 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1022): About to register with Master. 2023-11-18 20:53:24,411 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,44653,1700340801652 with isa=jenkins-hbase4.apache.org/172.31.14.131:32871, startcode=1700340802897 2023-11-18 20:53:24,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-18 20:53:24,432 DEBUG [RS:0;jenkins-hbase4:32871] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-18 20:53:24,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 20:53:24,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 20:53:24,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 20:53:24,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-18 20:53:24,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-18 20:53:24,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-18 20:53:24,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1700340834453 2023-11-18 20:53:24,458 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-18 20:53:24,459 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-18 20:53:24,460 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-18 20:53:24,467 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-18 20:53:24,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-18 20:53:24,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-18 20:53:24,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-18 20:53:24,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-18 20:53:24,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-18 20:53:24,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-18 20:53:24,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-18 20:53:24,491 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-18 20:53:24,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-18 20:53:24,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-18 20:53:24,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700340804498,5,FailOnTimeoutGroup] 2023-11-18 20:53:24,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700340804498,5,FailOnTimeoutGroup] 2023-11-18 20:53:24,498 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,499 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-18 20:53:24,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,502 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37137, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-18 20:53:24,515 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:24,516 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:24,516 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e 2023-11-18 20:53:24,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44653] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,551 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e 2023-11-18 20:53:24,552 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41799 2023-11-18 20:53:24,552 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-18 20:53:24,558 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 20:53:24,559 DEBUG [RS:0;jenkins-hbase4:32871] zookeeper.ZKUtil(162): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,559 WARN [RS:0;jenkins-hbase4:32871] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-18 20:53:24,572 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:24,571 INFO [RS:0;jenkins-hbase4:32871] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 20:53:24,574 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/WALs/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,577 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32871,1700340802897] 2023-11-18 20:53:24,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-18 20:53:24,589 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/info 2023-11-18 20:53:24,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-18 20:53:24,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:24,593 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-18 20:53:24,593 DEBUG [RS:0;jenkins-hbase4:32871] zookeeper.ZKUtil(162): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,596 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/rep_barrier 2023-11-18 20:53:24,597 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-18 20:53:24,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:24,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-18 20:53:24,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/table 2023-11-18 20:53:24,602 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-18 20:53:24,603 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:24,605 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740 2023-11-18 20:53:24,606 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-18 20:53:24,606 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740 2023-11-18 20:53:24,610 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-18 20:53:24,612 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-18 20:53:24,616 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:24,617 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62590078, jitterRate=-0.06733515858650208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-18 20:53:24,617 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-18 20:53:24,617 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-18 20:53:24,617 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-18 20:53:24,617 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-18 20:53:24,617 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-18 20:53:24,618 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-18 20:53:24,618 INFO [RS:0;jenkins-hbase4:32871] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-18 20:53:24,618 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-18 20:53:24,619 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-18 20:53:24,624 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-18 20:53:24,624 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-18 20:53:24,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-18 20:53:24,642 INFO [RS:0;jenkins-hbase4:32871] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-18 20:53:24,646 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-18 20:53:24,646 INFO [RS:0;jenkins-hbase4:32871] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:53:24,647 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,648 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-18 20:53:24,649 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-18 20:53:24,655 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,655 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,656 DEBUG [RS:0;jenkins-hbase4:32871] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-18 20:53:24,657 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,657 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,657 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,672 INFO [RS:0;jenkins-hbase4:32871] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-18 20:53:24,674 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32871,1700340802897-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:24,689 INFO [RS:0;jenkins-hbase4:32871] regionserver.Replication(203): jenkins-hbase4.apache.org,32871,1700340802897 started 2023-11-18 20:53:24,689 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32871,1700340802897, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32871, sessionid=0x1000245812a0001 2023-11-18 20:53:24,690 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-18 20:53:24,690 DEBUG [RS:0;jenkins-hbase4:32871] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,690 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32871,1700340802897' 2023-11-18 20:53:24,690 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32871,1700340802897' 2023-11-18 20:53:24,691 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 20:53:24,692 DEBUG [RS:0;jenkins-hbase4:32871] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 20:53:24,692 DEBUG [RS:0;jenkins-hbase4:32871] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-18 20:53:24,693 INFO [RS:0;jenkins-hbase4:32871] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-18 20:53:24,693 INFO [RS:0;jenkins-hbase4:32871] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-18 20:53:24,801 DEBUG [jenkins-hbase4:44653] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-18 20:53:24,803 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32871,1700340802897, state=OPENING 2023-11-18 20:53:24,808 INFO [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32871%2C1700340802897, suffix=, logDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/WALs/jenkins-hbase4.apache.org,32871,1700340802897, archiveDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/oldWALs, maxLogs=32 2023-11-18 20:53:24,812 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-18 20:53:24,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:24,814 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-18 20:53:24,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:24,834 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK] 2023-11-18 20:53:24,838 INFO [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/WALs/jenkins-hbase4.apache.org,32871,1700340802897/jenkins-hbase4.apache.org%2C32871%2C1700340802897.1700340804812 2023-11-18 20:53:24,838 DEBUG [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK]] 2023-11-18 20:53:25,003 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:25,005 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 20:53:25,008 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 20:53:25,020 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-18 20:53:25,020 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-18 20:53:25,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32871%2C1700340802897.meta, suffix=.meta, logDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/WALs/jenkins-hbase4.apache.org,32871,1700340802897, archiveDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/oldWALs, maxLogs=32 2023-11-18 20:53:25,043 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK] 2023-11-18 20:53:25,047 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/WALs/jenkins-hbase4.apache.org,32871,1700340802897/jenkins-hbase4.apache.org%2C32871%2C1700340802897.meta.1700340805028.meta 2023-11-18 20:53:25,051 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45853,DS-4ea3d247-6fcc-4dfc-b996-af33b42ddb9c,DISK]] 2023-11-18 20:53:25,051 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:25,054 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-18 20:53:25,073 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-18 20:53:25,079 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-18 20:53:25,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-18 20:53:25,085 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:25,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-18 20:53:25,086 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-18 20:53:25,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-18 20:53:25,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/info 2023-11-18 20:53:25,091 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/info 2023-11-18 20:53:25,092 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-18 20:53:25,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:25,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-18 20:53:25,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/rep_barrier 2023-11-18 20:53:25,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/rep_barrier 2023-11-18 20:53:25,096 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-18 20:53:25,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:25,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-18 20:53:25,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/table 2023-11-18 20:53:25,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/table 2023-11-18 20:53:25,100 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-18 20:53:25,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:25,102 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740 2023-11-18 20:53:25,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740 2023-11-18 20:53:25,109 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-18 20:53:25,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-18 20:53:25,114 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63275072, jitterRate=-0.057127952575683594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-18 20:53:25,114 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-18 20:53:25,124 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1700340804995 2023-11-18 20:53:25,143 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-18 20:53:25,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-18 20:53:25,145 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,32871,1700340802897, state=OPEN 2023-11-18 20:53:25,155 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-18 20:53:25,156 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-18 20:53:25,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-18 20:53:25,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,32871,1700340802897 in 337 msec 2023-11-18 20:53:25,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-18 20:53:25,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 527 msec 2023-11-18 20:53:25,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 822 msec 2023-11-18 20:53:25,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1700340805171, completionTime=-1 2023-11-18 20:53:25,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-18 20:53:25,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-18 20:53:25,235 DEBUG [hconnection-0x732a1a32-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:25,239 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:25,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-18 20:53:25,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1700340865255 2023-11-18 20:53:25,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1700340925255 2023-11-18 20:53:25,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 83 msec 2023-11-18 20:53:25,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44653,1700340801652-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:25,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44653,1700340801652-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:25,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44653,1700340801652-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:25,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44653, period=300000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:25,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-18 20:53:25,289 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-18 20:53:25,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-18 20:53:25,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-18 20:53:25,315 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-18 20:53:25,317 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:53:25,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:53:25,341 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:25,343 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1 empty. 2023-11-18 20:53:25,344 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:25,344 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-18 20:53:25,768 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:25,770 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0b7c545d2c54a566d30189d31a7147f1, NAME => 'hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0b7c545d2c54a566d30189d31a7147f1, disabling compactions & flushes 2023-11-18 20:53:26,183 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. after waiting 0 ms 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,183 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,183 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0b7c545d2c54a566d30189d31a7147f1: 2023-11-18 20:53:26,189 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:53:26,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700340806193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340806193"}]},"ts":"1700340806193"} 2023-11-18 20:53:26,236 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:53:26,238 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:53:26,242 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340806238"}]},"ts":"1700340806238"} 2023-11-18 20:53:26,245 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-18 20:53:26,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0b7c545d2c54a566d30189d31a7147f1, ASSIGN}] 2023-11-18 20:53:26,254 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0b7c545d2c54a566d30189d31a7147f1, ASSIGN 2023-11-18 20:53:26,255 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0b7c545d2c54a566d30189d31a7147f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:53:26,406 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0b7c545d2c54a566d30189d31a7147f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:26,407 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700340806406"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340806406"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340806406"}]},"ts":"1700340806406"} 2023-11-18 20:53:26,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0b7c545d2c54a566d30189d31a7147f1, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:26,565 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:26,571 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,572 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b7c545d2c54a566d30189d31a7147f1, NAME => 'hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:26,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:26,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,573 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,575 INFO [StoreOpener-0b7c545d2c54a566d30189d31a7147f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,577 DEBUG [StoreOpener-0b7c545d2c54a566d30189d31a7147f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/info 2023-11-18 20:53:26,577 DEBUG [StoreOpener-0b7c545d2c54a566d30189d31a7147f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/info 2023-11-18 20:53:26,578 INFO [StoreOpener-0b7c545d2c54a566d30189d31a7147f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b7c545d2c54a566d30189d31a7147f1 columnFamilyName info 2023-11-18 20:53:26,578 INFO [StoreOpener-0b7c545d2c54a566d30189d31a7147f1-1] regionserver.HStore(310): Store=0b7c545d2c54a566d30189d31a7147f1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:26,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,581 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,585 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:53:26,588 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:26,589 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0b7c545d2c54a566d30189d31a7147f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67200877, jitterRate=0.0013711005449295044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:26,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0b7c545d2c54a566d30189d31a7147f1: 2023-11-18 20:53:26,591 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1., pid=6, masterSystemTime=1700340806564 2023-11-18 20:53:26,595 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,595 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:53:26,596 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0b7c545d2c54a566d30189d31a7147f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:26,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1700340806595"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340806595"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340806595"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340806595"}]},"ts":"1700340806595"} 2023-11-18 20:53:26,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-18 20:53:26,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0b7c545d2c54a566d30189d31a7147f1, server=jenkins-hbase4.apache.org,32871,1700340802897 in 189 msec 2023-11-18 20:53:26,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-18 20:53:26,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0b7c545d2c54a566d30189d31a7147f1, ASSIGN in 351 msec 2023-11-18 20:53:26,607 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:53:26,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340806608"}]},"ts":"1700340806608"} 2023-11-18 20:53:26,610 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-18 20:53:26,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:53:26,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3110 sec 2023-11-18 20:53:26,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-18 20:53:26,620 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-18 20:53:26,620 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:53:26,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-18 20:53:26,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 20:53:26,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-11-18 20:53:26,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-18 20:53:26,695 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 20:53:26,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-11-18 20:53:26,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-18 20:53:26,715 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-18 20:53:26,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.740sec 2023-11-18 20:53:26,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-18 20:53:26,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-18 20:53:26,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-18 20:53:26,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44653,1700340801652-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-18 20:53:26,722 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44653,1700340801652-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-18 20:53:26,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-18 20:53:26,745 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2a962e to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:26,751 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a41f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:26,772 DEBUG [hconnection-0x6295a77a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:26,785 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:26,795 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:53:26,797 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(139): Connect 0x7faa020d to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:26,802 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41eb7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:26,803 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:53:26,848 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=170, AvailableMemoryMB=21067 2023-11-18 20:53:26,861 DEBUG [Listener at localhost/41997] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:53:26,865 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:53:26,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:53:26,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:26,882 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:53:26,885 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:53:26,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-18 20:53:26,888 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:26,889 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b empty. 2023-11-18 20:53:26,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:26,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-18 20:53:26,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 20:53:26,916 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:26,919 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 98730234eadd8cd0ebb305eddccd523b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 98730234eadd8cd0ebb305eddccd523b, disabling compactions & flushes 2023-11-18 20:53:26,937 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. after waiting 0 ms 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:26,937 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:26,937 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:26,943 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:53:26,944 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340806944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340806944"}]},"ts":"1700340806944"} 2023-11-18 20:53:26,947 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:53:26,949 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:53:26,949 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340806949"}]},"ts":"1700340806949"} 2023-11-18 20:53:26,952 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-18 20:53:26,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, ASSIGN}] 2023-11-18 20:53:26,959 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, ASSIGN 2023-11-18 20:53:26,961 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:53:27,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 20:53:27,112 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:27,113 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340807112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340807112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340807112"}]},"ts":"1700340807112"} 2023-11-18 20:53:27,116 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:27,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 20:53:27,271 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:27,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98730234eadd8cd0ebb305eddccd523b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,281 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,283 DEBUG [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:27,283 DEBUG [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:27,286 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98730234eadd8cd0ebb305eddccd523b columnFamilyName family1 2023-11-18 20:53:27,288 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] regionserver.HStore(310): Store=98730234eadd8cd0ebb305eddccd523b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:27,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:27,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:27,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98730234eadd8cd0ebb305eddccd523b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68446957, jitterRate=0.019939139485359192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:27,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:27,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., pid=11, masterSystemTime=1700340807271 2023-11-18 20:53:27,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:27,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:27,306 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:27,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340807306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340807306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340807306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340807306"}]},"ts":"1700340807306"} 2023-11-18 20:53:27,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-18 20:53:27,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897 in 194 msec 2023-11-18 20:53:27,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-18 20:53:27,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, ASSIGN in 356 msec 2023-11-18 20:53:27,319 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:53:27,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340807319"}]},"ts":"1700340807319"} 2023-11-18 20:53:27,322 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-18 20:53:27,326 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:53:27,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 448 msec 2023-11-18 20:53:27,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-18 20:53:27,509 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-18 20:53:27,531 DEBUG [hconnection-0x14b40d8c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:27,534 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:27,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:27,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,701 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:27,701 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:27,702 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:27,702 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:27,702 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,703 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,704 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:27,704 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:27,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:27,705 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:27,705 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,707 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:27,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:27,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:27,710 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:27,711 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:27,711 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:27,711 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:27,713 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:27,714 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:53:28,282 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303797bb6b78644a7da204a82bea73e899 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303797bb6b78644a7da204a82bea73e899 2023-11-18 20:53:28,703 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/948c59b91dd9486d9554008f0b22fbc7 2023-11-18 20:53:28,718 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/948c59b91dd9486d9554008f0b22fbc7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7 2023-11-18 20:53:28,732 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-18 20:53:28,736 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 1022ms, sequenceid=5, compaction requested=false 2023-11-18 20:53:28,738 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:28,742 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:28,742 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:28,742 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:28,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:28,746 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,746 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:28,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:28,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:28,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:28,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b957417[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:28,750 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:28,750 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,752 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:28,752 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:28,752 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,752 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:28,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:28,755 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:28,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:28,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:28,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:28,763 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:28,763 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:28,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:28,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:28,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,764 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:28,770 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,770 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,770 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:28,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:28,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:28,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:28,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:28,771 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,774 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,783 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:28,783 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:28,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:28,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:28,786 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:28,786 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:28,887 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:28,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:28,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:28,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:28,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,904 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:28,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:28,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:28,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:28,905 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,905 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,910 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,910 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:28,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:28,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:28,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,912 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:28,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:28,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:28,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:28,913 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:53:29,342 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112885e64eb2b385468b941e64425073561d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885e64eb2b385468b941e64425073561d 2023-11-18 20:53:29,754 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/256e07f65fab474aa65fd232c7089f78 2023-11-18 20:53:29,766 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/256e07f65fab474aa65fd232c7089f78 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78 2023-11-18 20:53:29,776 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:53:29,778 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 865ms, sequenceid=9, compaction requested=false 2023-11-18 20:53:29,778 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:29,778 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:29,778 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:29,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:29,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:29,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:29,782 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:29,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,782 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:29,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:29,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:29,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@241391f9[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:29,785 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:29,785 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,787 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:29,787 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:29,787 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,787 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:29,789 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:29,789 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,790 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:29,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:29,790 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:29,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:29,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:29,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:29,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:29,798 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:29,798 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:29,798 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:29,798 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,798 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:29,804 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,804 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:29,804 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:29,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:29,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:29,808 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,810 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:29,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,818 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,818 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:29,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:29,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,819 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:29,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:29,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:29,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:29,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:29,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:29,820 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:29,820 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:29,921 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:29,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:29,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:29,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:29,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,944 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:29,944 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:29,945 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:29,945 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:29,946 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,946 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,947 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:29,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:29,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:29,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,950 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:29,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:29,950 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:29,950 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:29,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:29,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:29,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:29,951 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:29,952 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:29,952 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:30,383 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120128550e70fee840b4ab930579451fc298 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120128550e70fee840b4ab930579451fc298 2023-11-18 20:53:30,394 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/98af426ba305418c8c77a5e6ce46a863 2023-11-18 20:53:30,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/98af426ba305418c8c77a5e6ce46a863 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863 2023-11-18 20:53:30,412 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 20:53:30,413 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 462ms, sequenceid=13, compaction requested=true 2023-11-18 20:53:30,413 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:30,414 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:30,414 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:30,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,417 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:30,417 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,417 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:30,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:30,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:30,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:30,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e638629[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:30,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:30,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,422 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:30,423 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:30,423 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,423 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:30,425 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:30,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:30,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:30,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:30,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:30,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:30,429 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,430 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:30,432 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,432 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,432 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:30,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:30,433 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:30,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,436 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:30,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:30,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:30,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,442 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,443 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,443 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:30,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:30,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:30,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:30,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:30,444 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:30,444 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:30,544 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:30,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:30,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:30,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:30,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,559 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:30,559 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:30,559 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:30,559 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:30,560 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,560 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,564 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,564 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:30,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:30,565 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:30,565 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:30,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:30,567 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:30,567 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:30,568 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:30,568 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:30,568 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:30,568 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:30,568 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:30,568 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:30,612 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:53:30,637 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120509b2cdc604c643bbad375454cdb81c22 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509b2cdc604c643bbad375454cdb81c22 2023-11-18 20:53:30,727 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-18 20:53:30,729 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-18 20:53:31,086 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/c21a4711747a4086a7584f77986696d6 2023-11-18 20:53:31,097 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/c21a4711747a4086a7584f77986696d6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6 2023-11-18 20:53:31,106 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 20:53:31,107 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 539ms, sequenceid=17, compaction requested=true 2023-11-18 20:53:31,107 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:31,107 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:31,107 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:31,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:31,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,111 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:31,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@427f1953[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:31,113 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:31,113 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,114 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,115 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:31,115 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:31,115 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:31,115 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,115 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:31,117 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:31,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:31,122 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:31,122 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:31,122 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:31,122 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,122 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:31,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,129 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,132 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:31,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,137 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:31,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:31,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:31,138 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,138 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,139 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:31,139 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:31,239 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:31,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:31,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:31,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:31,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,250 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:31,251 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:31,251 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:31,251 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:31,252 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,252 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,253 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,253 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:31,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:31,254 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,254 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,254 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:31,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,255 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:31,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:31,256 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:31,256 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:31,256 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:31,256 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:31,682 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285ee184d72e2549408b259dd7f789d21c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285ee184d72e2549408b259dd7f789d21c 2023-11-18 20:53:31,696 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/e264bcec7ab249438a005ce09ae6f00f 2023-11-18 20:53:31,706 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/e264bcec7ab249438a005ce09ae6f00f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f 2023-11-18 20:53:31,714 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 20:53:31,715 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 459ms, sequenceid=21, compaction requested=true 2023-11-18 20:53:31,715 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:31,715 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:31,716 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:31,718 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,718 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:31,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72fae8c7[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:31,721 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:31,721 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,723 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:31,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:31,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:31,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:31,725 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,725 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,726 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:31,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:31,730 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:31,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:31,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:31,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,730 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:31,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,732 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,734 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:31,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,738 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:31,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,739 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:31,739 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:31,825 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-18 20:53:31,825 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-18 20:53:31,839 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:31,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:31,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:31,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:31,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,853 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:31,853 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:31,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:31,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:31,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,857 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,857 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:31,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:31,857 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,857 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:31,858 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:31,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,859 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,859 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:31,859 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:31,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:31,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:31,860 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:31,860 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:31,860 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:31,883 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a6a68aaaa5504940950c32197cab1eda to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6a68aaaa5504940950c32197cab1eda 2023-11-18 20:53:31,896 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/e5c3dfb0d689412080048a35d8bd5719 2023-11-18 20:53:31,909 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/e5c3dfb0d689412080048a35d8bd5719 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719 2023-11-18 20:53:31,917 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 20:53:31,919 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 59ms, sequenceid=25, compaction requested=true 2023-11-18 20:53:31,920 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:31,920 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:31,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:31,923 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,923 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,923 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,923 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:31,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ade3338[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:31,926 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:31,926 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,928 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:31,928 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:31,929 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,929 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:31,931 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:31,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:31,935 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:31,935 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:31,935 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:31,935 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,935 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:31,938 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,938 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:31,938 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:31,939 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,941 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:31,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:31,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:31,945 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:31,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:31,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:31,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:31,946 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,946 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:31,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:31,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:31,946 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:31,946 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:32,047 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:32,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:32,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,059 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:32,059 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,060 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:32,060 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:32,061 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,061 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,062 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:32,063 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:32,063 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,063 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:32,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:32,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,065 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,065 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:32,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,065 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:32,065 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:32,066 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:32,066 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:32,066 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:32,066 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:32,093 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010130a1bf693e3247f4b33588ae47863a1d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010130a1bf693e3247f4b33588ae47863a1d 2023-11-18 20:53:32,103 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/ab19e0fe3770438492b97229e05f0819 2023-11-18 20:53:32,111 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/ab19e0fe3770438492b97229e05f0819 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819 2023-11-18 20:53:32,120 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 20:53:32,121 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 55ms, sequenceid=29, compaction requested=true 2023-11-18 20:53:32,121 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:32,122 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:32,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:32,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:32,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:32,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:32,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,128 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:32,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@480ea684[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:32,132 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:32,132 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,134 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,135 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:32,136 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,136 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:32,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:32,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:32,139 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:32,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:32,144 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:32,144 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:32,144 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:32,144 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,144 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:32,146 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,146 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,146 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:32,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:32,147 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,149 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:32,153 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:32,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:32,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:32,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:32,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:32,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:32,154 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,154 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,154 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,154 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:32,154 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:32,255 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:32,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,267 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:32,267 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,267 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:32,267 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:32,268 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,268 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,269 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:32,269 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:32,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:32,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,271 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,272 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:32,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:32,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:32,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:32,273 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:32,273 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:32,273 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:32,697 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fc46e217bd2a46f984ae79b30f686412 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc46e217bd2a46f984ae79b30f686412 2023-11-18 20:53:32,708 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/1eed46b497024424897ca4918f5d7aae 2023-11-18 20:53:32,717 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/1eed46b497024424897ca4918f5d7aae as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae 2023-11-18 20:53:32,726 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 20:53:32,727 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 454ms, sequenceid=33, compaction requested=true 2023-11-18 20:53:32,727 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:32,727 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:32,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:32,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:32,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:32,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:32,730 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,730 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,731 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:32,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72018b57[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:32,735 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:32,735 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:32,737 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:32,737 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,737 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:32,740 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:32,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:32,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:32,744 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:32,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:32,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:32,745 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,745 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:32,747 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,747 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:32,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,747 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:32,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:32,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:32,753 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:32,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,756 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:32,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,759 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,759 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:32,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:32,759 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,760 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:32,760 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:32,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:32,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:32,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:32,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:32,760 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,761 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:32,862 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:32,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:32,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:32,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:32,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,872 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:32,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:32,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:32,874 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,874 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,875 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:32,875 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:32,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:32,876 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:32,876 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:32,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:32,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,877 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,877 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:32,877 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:32,878 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:32,879 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:32,879 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:32,879 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:32,879 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:32,879 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:32,879 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:32,880 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:33,308 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074c5f0da8a89f40379212cae0c643976d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509074c5f0da8a89f40379212cae0c643976d 2023-11-18 20:53:33,717 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/a82f0d2cef5143f3a85cfe3028f64a60 2023-11-18 20:53:33,727 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/a82f0d2cef5143f3a85cfe3028f64a60 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60 2023-11-18 20:53:33,735 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 20:53:33,737 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 858ms, sequenceid=37, compaction requested=true 2023-11-18 20:53:33,737 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:33,737 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:33,737 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:33,738 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:33,741 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,741 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:33,742 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,742 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:33,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:33,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5798e900[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:33,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:33,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,746 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:33,746 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:33,746 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,746 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:33,748 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,748 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:33,748 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:33,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:33,748 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:33,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:33,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:33,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:33,755 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:33,755 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:33,755 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:33,755 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,755 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:33,757 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,757 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,758 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:33,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:33,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:33,759 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:33,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:33,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:33,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:33,775 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:33,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:33,777 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:33,777 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:33,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:33,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:33,877 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:33,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:33,886 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:33,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,888 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:33,889 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:33,889 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-18 20:53:33,889 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-18 20:53:33,890 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,890 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,891 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:33,891 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:33,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:33,892 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:33,892 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:33,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:33,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,893 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,893 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-18 20:53:33,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-18 20:53:33,893 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:33,894 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-18 20:53:33,894 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:33,894 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:33,894 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:33,894 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. started... 2023-11-18 20:53:33,894 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 98730234eadd8cd0ebb305eddccd523b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:34,315 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205e829f2e17fe4442af90d6a18c0def4e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205e829f2e17fe4442af90d6a18c0def4e 2023-11-18 20:53:34,724 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/465be845e3364cd2b0386ca121c58b8d 2023-11-18 20:53:34,732 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/465be845e3364cd2b0386ca121c58b8d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d 2023-11-18 20:53:34,738 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 20:53:34,739 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 98730234eadd8cd0ebb305eddccd523b in 845ms, sequenceid=41, compaction requested=true 2023-11-18 20:53:34,739 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:34,739 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:34,739 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-18 20:53:34,740 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-18 20:53:34,742 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:34,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,743 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:34,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-18 20:53:34,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c645738[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:34,757 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-18 20:53:34,757 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,758 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-18 20:53:34,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-18 20:53:34,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:34,758 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,758 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:34,760 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,760 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-18 20:53:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:34,760 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:34,760 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-18 20:53:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:34,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:34,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-18 20:53:34,764 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-18 20:53:34,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:34,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:34,764 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,764 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:34,768 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,768 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:34,768 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:34,768 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,770 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:34,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:34,773 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:34,774 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:34,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-18 20:53:34,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-18 20:53:34,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:34,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:34,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,774 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,774 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:34,774 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:34,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:34,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:34,874 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:34,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:34,881 DEBUG [Listener at localhost/41997] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 20:53:34,883 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 20:53:34,885 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:34,900 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:34,901 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:34,902 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341414902 2023-11-18 20:53:34,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:34,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:53:34,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-18 20:53:34,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:34,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x54665abf to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:34,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f53415e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:34,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:35,797 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035b07ebf083d04cacb7498895d0258860 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601035b07ebf083d04cacb7498895d0258860 2023-11-18 20:53:35,800 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:35,824 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:35,826 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:35,844 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:53:35,847 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:53:35,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b9e7a18665f456ea010d1fd449e1eb7 first=Optional[r3] last=Optional[r6] 2023-11-18 20:53:35,933 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b9e7a18665f456ea010d1fd449e1eb7}] 2023-11-18 20:53:35,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b9e7a18665f456ea010d1fd449e1eb7 for inclusion in 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:35,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 20:53:35,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:35,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2b9e7a18665f456ea010d1fd449e1eb7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g5jeuc85f1keob53kqa08v73or03dtetp0ccsmv4ifqtt2luhc0oj8mv6j6u25i6/family1/2b9e7a18665f456ea010d1fd449e1eb7 2023-11-18 20:53:35,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g5jeuc85f1keob53kqa08v73or03dtetp0ccsmv4ifqtt2luhc0oj8mv6j6u25i6/family1/2b9e7a18665f456ea010d1fd449e1eb7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_ 2023-11-18 20:53:35,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g5jeuc85f1keob53kqa08v73or03dtetp0ccsmv4ifqtt2luhc0oj8mv6j6u25i6/family1/2b9e7a18665f456ea010d1fd449e1eb7 into 98730234eadd8cd0ebb305eddccd523b/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_ - updating store file list. 2023-11-18 20:53:35,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_ into 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:35,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g5jeuc85f1keob53kqa08v73or03dtetp0ccsmv4ifqtt2luhc0oj8mv6j6u25i6/family1/2b9e7a18665f456ea010d1fd449e1eb7 into 98730234eadd8cd0ebb305eddccd523b/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_) 2023-11-18 20:53:35,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__g5jeuc85f1keob53kqa08v73or03dtetp0ccsmv4ifqtt2luhc0oj8mv6j6u25i6/family1/2b9e7a18665f456ea010d1fd449e1eb7 2023-11-18 20:53:35,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:53:35,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:53:35,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 98730234eadd8cd0ebb305eddccd523b/family1 is initiating minor compaction 2023-11-18 20:53:35,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f2f01b9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:35,996 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 98730234eadd8cd0ebb305eddccd523b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:35,997 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp, totalSize=50.2 K 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 256e07f65fab474aa65fd232c7089f78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 98af426ba305418c8c77a5e6ce46a863, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting c21a4711747a4086a7584f77986696d6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting e264bcec7ab249438a005ce09ae6f00f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting e5c3dfb0d689412080048a35d8bd5719, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ab19e0fe3770438492b97229e05f0819, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 1eed46b497024424897ca4918f5d7aae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting a82f0d2cef5143f3a85cfe3028f64a60, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 465be845e3364cd2b0386ca121c58b8d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:53:35,998 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting d540639dda72498c951d80d271cba166_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:53:36,013 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:36,015 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:36,022 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285ee184d72e2549408b259dd7f789d21c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285ee184d72e2549408b259dd7f789d21c 2023-11-18 20:53:36,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6a68aaaa5504940950c32197cab1eda to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231a6a68aaaa5504940950c32197cab1eda 2023-11-18 20:53:36,027 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010130a1bf693e3247f4b33588ae47863a1d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010130a1bf693e3247f4b33588ae47863a1d 2023-11-18 20:53:36,031 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc46e217bd2a46f984ae79b30f686412 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103fc46e217bd2a46f984ae79b30f686412 2023-11-18 20:53:36,031 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-18 20:53:36,031 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:36,074 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 98730234eadd8cd0ebb305eddccd523b#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:53:36,926 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/796d833988f84c5e988d98185dee485b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/796d833988f84c5e988d98185dee485b 2023-11-18 20:53:36,945 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 98730234eadd8cd0ebb305eddccd523b/family1 of 98730234eadd8cd0ebb305eddccd523b into 796d833988f84c5e988d98185dee485b(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:53:36,945 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:36,947 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1700340815992; duration=0sec 2023-11-18 20:53:36,948 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:36,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_] to archive 2023-11-18 20:53:36,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:36,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/256e07f65fab474aa65fd232c7089f78 2023-11-18 20:53:36,975 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120564795c43d6f8416c8b66386fb63a4880 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120564795c43d6f8416c8b66386fb63a4880 2023-11-18 20:53:36,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/98af426ba305418c8c77a5e6ce46a863 2023-11-18 20:53:36,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:36,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/c21a4711747a4086a7584f77986696d6 2023-11-18 20:53:36,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e264bcec7ab249438a005ce09ae6f00f 2023-11-18 20:53:36,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/e5c3dfb0d689412080048a35d8bd5719 2023-11-18 20:53:36,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ab19e0fe3770438492b97229e05f0819 2023-11-18 20:53:36,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/1eed46b497024424897ca4918f5d7aae 2023-11-18 20:53:36,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/a82f0d2cef5143f3a85cfe3028f64a60 2023-11-18 20:53:36,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/465be845e3364cd2b0386ca121c58b8d 2023-11-18 20:53:36,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/d540639dda72498c951d80d271cba166_SeqId_44_ 2023-11-18 20:53:37,018 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0f3f2c32dd414977af74f7cc9cd4816c first=Optional[r00] last=Optional[r2] 2023-11-18 20:53:37,019 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0f3f2c32dd414977af74f7cc9cd4816c}] 2023-11-18 20:53:37,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0f3f2c32dd414977af74f7cc9cd4816c for inclusion in 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 20:53:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:37,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0f3f2c32dd414977af74f7cc9cd4816c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tnrq3n0pbs4ra79udm7blhnq1iav18rs0bnj84djvthjj3rgdfl4o6tjaul1qq4p/family1/0f3f2c32dd414977af74f7cc9cd4816c 2023-11-18 20:53:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tnrq3n0pbs4ra79udm7blhnq1iav18rs0bnj84djvthjj3rgdfl4o6tjaul1qq4p/family1/0f3f2c32dd414977af74f7cc9cd4816c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_ 2023-11-18 20:53:37,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tnrq3n0pbs4ra79udm7blhnq1iav18rs0bnj84djvthjj3rgdfl4o6tjaul1qq4p/family1/0f3f2c32dd414977af74f7cc9cd4816c into 98730234eadd8cd0ebb305eddccd523b/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_ - updating store file list. 2023-11-18 20:53:37,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_ into 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:37,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tnrq3n0pbs4ra79udm7blhnq1iav18rs0bnj84djvthjj3rgdfl4o6tjaul1qq4p/family1/0f3f2c32dd414977af74f7cc9cd4816c into 98730234eadd8cd0ebb305eddccd523b/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_) 2023-11-18 20:53:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tnrq3n0pbs4ra79udm7blhnq1iav18rs0bnj84djvthjj3rgdfl4o6tjaul1qq4p/family1/0f3f2c32dd414977af74f7cc9cd4816c 2023-11-18 20:53:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:53:37,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:53:37,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 98730234eadd8cd0ebb305eddccd523b/family1 is initiating minor compaction (all files) 2023-11-18 20:53:37,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@668c5ced; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:37,042 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 98730234eadd8cd0ebb305eddccd523b/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,043 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/796d833988f84c5e988d98185dee485b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp, totalSize=358.6 K 2023-11-18 20:53:37,044 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 948c59b91dd9486d9554008f0b22fbc7, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:53:37,045 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 796d833988f84c5e988d98185dee485b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:53:37,045 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ae4975fa4f804f3b955a1612751f62f8_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826804 2023-11-18 20:53:37,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:37,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:37,049 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303797bb6b78644a7da204a82bea73e899 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511303797bb6b78644a7da204a82bea73e899 2023-11-18 20:53:37,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120128550e70fee840b4ab930579451fc298 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120128550e70fee840b4ab930579451fc298 2023-11-18 20:53:37,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509b2cdc604c643bbad375454cdb81c22 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120509b2cdc604c643bbad375454cdb81c22 2023-11-18 20:53:37,052 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-18 20:53:37,052 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 20:53:37,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:37,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:37,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:37,054 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:37,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.1640 sec 2023-11-18 20:53:37,081 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 98730234eadd8cd0ebb305eddccd523b#family1#compaction#11 average throughput is 7.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:53:37,160 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/.tmp/family1/f139b50cbeef45f787e49b8260cfe1db as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/f139b50cbeef45f787e49b8260cfe1db 2023-11-18 20:53:37,169 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 98730234eadd8cd0ebb305eddccd523b/family1 of 98730234eadd8cd0ebb305eddccd523b into f139b50cbeef45f787e49b8260cfe1db(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:53:37,169 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:37,169 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1700340817042; duration=0sec 2023-11-18 20:53:37,169 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:37,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/796d833988f84c5e988d98185dee485b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_] to archive 2023-11-18 20:53:37,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:37,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/948c59b91dd9486d9554008f0b22fbc7 2023-11-18 20:53:37,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/796d833988f84c5e988d98185dee485b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/796d833988f84c5e988d98185dee485b 2023-11-18 20:53:37,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/ae4975fa4f804f3b955a1612751f62f8_SeqId_47_ 2023-11-18 20:53:37,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 20:53:37,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:37,330 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-18 20:53:37,332 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:37,333 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-18 20:53:37,339 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-18 20:53:37,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, REOPEN/MOVE}] 2023-11-18 20:53:37,358 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, REOPEN/MOVE 2023-11-18 20:53:37,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:37,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340817359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340817359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340817359"}]},"ts":"1700340817359"} 2023-11-18 20:53:37,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:37,522 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:37,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98730234eadd8cd0ebb305eddccd523b, disabling compactions & flushes 2023-11-18 20:53:37,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. after waiting 0 ms 2023-11-18 20:53:37,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 20:53:37,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:37,532 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 98730234eadd8cd0ebb305eddccd523b to self. 2023-11-18 20:53:37,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,535 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=CLOSED 2023-11-18 20:53:37,535 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340817535"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340817535"}]},"ts":"1700340817535"} 2023-11-18 20:53:37,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-18 20:53:37,539 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897 in 174 msec 2023-11-18 20:53:37,540 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=true 2023-11-18 20:53:37,690 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:37,690 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340817690"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340817690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340817690"}]},"ts":"1700340817690"} 2023-11-18 20:53:37,693 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:37,845 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:37,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 98730234eadd8cd0ebb305eddccd523b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:37,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:37,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,853 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,854 DEBUG [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:37,854 DEBUG [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:37,855 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98730234eadd8cd0ebb305eddccd523b columnFamilyName family1 2023-11-18 20:53:37,864 DEBUG [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/f139b50cbeef45f787e49b8260cfe1db 2023-11-18 20:53:37,865 INFO [StoreOpener-98730234eadd8cd0ebb305eddccd523b-1] regionserver.HStore(310): Store=98730234eadd8cd0ebb305eddccd523b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:37,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:53:37,873 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 98730234eadd8cd0ebb305eddccd523b; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67716151, jitterRate=0.009049281477928162}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:37,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:37,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., pid=17, masterSystemTime=1700340817845 2023-11-18 20:53:37,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:53:37,877 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=98730234eadd8cd0ebb305eddccd523b, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:37,878 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1700340817877"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340817877"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340817877"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340817877"}]},"ts":"1700340817877"} 2023-11-18 20:53:37,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-18 20:53:37,882 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 98730234eadd8cd0ebb305eddccd523b, server=jenkins-hbase4.apache.org,32871,1700340802897 in 187 msec 2023-11-18 20:53:37,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-18 20:53:37,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=98730234eadd8cd0ebb305eddccd523b, REOPEN/MOVE in 525 msec 2023-11-18 20:53:37,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-18 20:53:37,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 549 msec 2023-11-18 20:53:37,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 592 msec 2023-11-18 20:53:37,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-18 20:53:37,901 INFO [Listener at localhost/41997] compactions.TestMobCompactor(278): alter status finished 2023-11-18 20:53:37,902 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-18 20:53:37,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:37,905 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:37,906 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341417906 2023-11-18 20:53:37,906 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:37,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:53:37,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-18 20:53:37,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:37,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x28f85fc9 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:37,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e594bfe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:37,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:38,751 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286c422216f13e4d53a37850966eb834f4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511286c422216f13e4d53a37850966eb834f4 2023-11-18 20:53:38,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:38,772 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:38,773 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:38,781 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:53:38,783 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:53:38,797 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bfe4138bcbed4311a1838ae2fd464f9b first=Optional[r05] last=Optional[r8] 2023-11-18 20:53:38,798 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bfe4138bcbed4311a1838ae2fd464f9b}] 2023-11-18 20:53:38,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bfe4138bcbed4311a1838ae2fd464f9b for inclusion in 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:38,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 20:53:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:38,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:53:38,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/bfe4138bcbed4311a1838ae2fd464f9b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jmv3md7c5s372vd887k1h3ktro9ufc7f4abkmpilpthuru4gjgauupocick7h1g9/family1/bfe4138bcbed4311a1838ae2fd464f9b 2023-11-18 20:53:38,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jmv3md7c5s372vd887k1h3ktro9ufc7f4abkmpilpthuru4gjgauupocick7h1g9/family1/bfe4138bcbed4311a1838ae2fd464f9b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/14e03c36a36a435cb0afffbcfbe284ea_SeqId_53_ 2023-11-18 20:53:38,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jmv3md7c5s372vd887k1h3ktro9ufc7f4abkmpilpthuru4gjgauupocick7h1g9/family1/bfe4138bcbed4311a1838ae2fd464f9b into 98730234eadd8cd0ebb305eddccd523b/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/14e03c36a36a435cb0afffbcfbe284ea_SeqId_53_ - updating store file list. 2023-11-18 20:53:38,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/14e03c36a36a435cb0afffbcfbe284ea_SeqId_53_ into 98730234eadd8cd0ebb305eddccd523b/family1 2023-11-18 20:53:38,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jmv3md7c5s372vd887k1h3ktro9ufc7f4abkmpilpthuru4gjgauupocick7h1g9/family1/bfe4138bcbed4311a1838ae2fd464f9b into 98730234eadd8cd0ebb305eddccd523b/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/family1/14e03c36a36a435cb0afffbcfbe284ea_SeqId_53_) 2023-11-18 20:53:38,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__jmv3md7c5s372vd887k1h3ktro9ufc7f4abkmpilpthuru4gjgauupocick7h1g9/family1/bfe4138bcbed4311a1838ae2fd464f9b 2023-11-18 20:53:38,832 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:38,833 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:38,835 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205e829f2e17fe4442af90d6a18c0def4e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511205e829f2e17fe4442af90d6a18c0def4e 2023-11-18 20:53:38,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885e64eb2b385468b941e64425073561d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112885e64eb2b385468b941e64425073561d 2023-11-18 20:53:38,837 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-18 20:53:38,837 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 20:53:38,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:38,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:38,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-18 20:53:38,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-18 20:53:38,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:38,839 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-18 20:53:38,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 936 msec 2023-11-18 20:53:38,933 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 214) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1641fab5-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50512 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x54665abf sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/322049390.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50528 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50670 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x54665abf-SendThread(127.0.0.1:55479) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: (jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50538 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:32871-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50718 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x28f85fc9-SendThread(127.0.0.1:55479) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x200a1763-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-239664644_17 at /127.0.0.1:50534 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x200a1763-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50624 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50628 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x54665abf-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50642 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50664 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x28f85fc9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/322049390.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x28f85fc9-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x1641fab5-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1641fab5-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50612 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50598 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50708 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50556 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50464 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=618 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 313), ProcessCount=172 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=20717 (was 21067) 2023-11-18 20:53:38,948 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=618, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=172, AvailableMemoryMB=20716 2023-11-18 20:53:38,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 20:53:38,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:38,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:53:38,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-18 20:53:38,955 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:53:38,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:38,957 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:38,958 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c empty. 2023-11-18 20:53:38,959 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:38,959 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-18 20:53:39,011 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:53:39,014 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54665abf to 127.0.0.1:55479 2023-11-18 20:53:39,014 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:53:39,022 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:53:39,026 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28f85fc9 to 127.0.0.1:55479 2023-11-18 20:53:39,026 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:53:39,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:39,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:39,425 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:39,426 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c8a50b8965738f174a5cd6c2d8fd9f7c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:53:39,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing c8a50b8965738f174a5cd6c2d8fd9f7c, disabling compactions & flushes 2023-11-18 20:53:39,833 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. after waiting 0 ms 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:39,833 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:39,833 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:39,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:53:39,838 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340819838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340819838"}]},"ts":"1700340819838"} 2023-11-18 20:53:39,840 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:53:39,842 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:53:39,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340819842"}]},"ts":"1700340819842"} 2023-11-18 20:53:39,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-18 20:53:39,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=c8a50b8965738f174a5cd6c2d8fd9f7c, ASSIGN}] 2023-11-18 20:53:39,849 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=c8a50b8965738f174a5cd6c2d8fd9f7c, ASSIGN 2023-11-18 20:53:39,850 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=c8a50b8965738f174a5cd6c2d8fd9f7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:53:40,002 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c8a50b8965738f174a5cd6c2d8fd9f7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:40,002 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340820001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340820001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340820001"}]},"ts":"1700340820001"} 2023-11-18 20:53:40,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure c8a50b8965738f174a5cd6c2d8fd9f7c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:40,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:40,156 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:40,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:40,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8a50b8965738f174a5cd6c2d8fd9f7c, NAME => 'testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:40,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:40,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,162 INFO [StoreOpener-c8a50b8965738f174a5cd6c2d8fd9f7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,163 DEBUG [StoreOpener-c8a50b8965738f174a5cd6c2d8fd9f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:40,163 DEBUG [StoreOpener-c8a50b8965738f174a5cd6c2d8fd9f7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:40,163 INFO [StoreOpener-c8a50b8965738f174a5cd6c2d8fd9f7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8a50b8965738f174a5cd6c2d8fd9f7c columnFamilyName family1 2023-11-18 20:53:40,165 INFO [StoreOpener-c8a50b8965738f174a5cd6c2d8fd9f7c-1] regionserver.HStore(310): Store=c8a50b8965738f174a5cd6c2d8fd9f7c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:40,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:53:40,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:40,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c8a50b8965738f174a5cd6c2d8fd9f7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60545654, jitterRate=-0.09779945015907288}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:40,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:40,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., pid=21, masterSystemTime=1700340820156 2023-11-18 20:53:40,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:40,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:40,174 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=c8a50b8965738f174a5cd6c2d8fd9f7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:40,175 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340820174"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340820174"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340820174"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340820174"}]},"ts":"1700340820174"} 2023-11-18 20:53:40,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-18 20:53:40,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure c8a50b8965738f174a5cd6c2d8fd9f7c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 172 msec 2023-11-18 20:53:40,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-18 20:53:40,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=c8a50b8965738f174a5cd6c2d8fd9f7c, ASSIGN in 332 msec 2023-11-18 20:53:40,182 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:53:40,182 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340820182"}]},"ts":"1700340820182"} 2023-11-18 20:53:40,183 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-18 20:53:40,210 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:53:40,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2600 sec 2023-11-18 20:53:41,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-18 20:53:41,062 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-18 20:53:41,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:41,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,105 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:41,105 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:41,106 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:41,106 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:41,107 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,107 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,140 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,140 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:41,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:41,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:41,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:41,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,142 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:41,142 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:41,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:41,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:41,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:41,143 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:41,143 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:41,143 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:53:41,172 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e37584811aa142e38b4b0370a56dea90 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130e37584811aa142e38b4b0370a56dea90 2023-11-18 20:53:41,577 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/ae6d53691a264a61b47cceed82dadf31 2023-11-18 20:53:41,583 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/ae6d53691a264a61b47cceed82dadf31 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31 2023-11-18 20:53:41,589 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-18 20:53:41,590 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 447ms, sequenceid=5, compaction requested=false 2023-11-18 20:53:41,590 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:41,591 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:41,591 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:41,591 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:41,591 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:41,591 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,591 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:41,591 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:41,664 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:41,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:41,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:41,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:41,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e3f6b6[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:41,666 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:41,666 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,717 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:41,718 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,718 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:41,718 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:41,779 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:41,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:41,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:41,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:41,779 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:41,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:41,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:41,783 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:41,783 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:41,783 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:41,783 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,783 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:41,787 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,787 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,787 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:41,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:41,788 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,789 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,806 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,807 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:41,807 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:41,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:41,807 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:41,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:41,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:41,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:41,807 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:41,808 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:41,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:41,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:41,908 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:41,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:41,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:41,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,916 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:41,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:41,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:41,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:41,917 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,917 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,918 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:41,918 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:41,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:41,919 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:41,919 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:41,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:41,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,920 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:41,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:41,920 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:41,921 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:41,921 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:41,921 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:41,921 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:53:42,335 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287a6685b9beb7454eb7655e18feb04d75 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287a6685b9beb7454eb7655e18feb04d75 2023-11-18 20:53:42,742 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/14072a8b141a440aa0bd7c0d6398c779 2023-11-18 20:53:42,748 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/14072a8b141a440aa0bd7c0d6398c779 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779 2023-11-18 20:53:42,754 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:53:42,755 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 834ms, sequenceid=9, compaction requested=false 2023-11-18 20:53:42,755 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:42,755 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:42,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:42,757 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:42,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:42,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:42,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:42,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:42,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:42,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2fc694ee[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:42,759 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:42,760 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,762 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,762 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:42,762 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:42,762 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:42,762 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,762 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:42,763 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:42,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:42,767 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:42,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:42,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:42,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,767 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:42,769 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,769 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:42,769 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:42,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:42,770 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,772 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:42,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:42,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:42,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:42,775 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:42,775 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,776 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:42,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:42,776 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:42,877 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:42,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:42,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:42,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,885 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:42,885 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:42,885 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:42,885 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:42,886 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,886 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,889 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,889 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:42,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:42,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:42,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,891 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:42,891 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:42,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:42,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,893 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:42,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:42,896 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:42,900 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:42,900 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:42,900 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:42,925 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201cb44b309d7d2403ba1d0d1a6fe1e4a87 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb44b309d7d2403ba1d0d1a6fe1e4a87 2023-11-18 20:53:43,066 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:53:43,334 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/cae11be616304873a9d1e2be17118277 2023-11-18 20:53:43,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/cae11be616304873a9d1e2be17118277 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277 2023-11-18 20:53:43,347 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 20:53:43,349 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 449ms, sequenceid=13, compaction requested=true 2023-11-18 20:53:43,349 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:43,349 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:43,349 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:43,349 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:43,349 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,349 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:43,349 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,352 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:43,352 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:43,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:43,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:43,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:43,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f86a8ff[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:43,356 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:43,356 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,357 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,357 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:43,357 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:43,357 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:43,357 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,358 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:43,359 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:43,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:43,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:43,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:43,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:43,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:43,363 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:43,363 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:43,363 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:43,363 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,363 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:43,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:43,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:43,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:43,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:43,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,369 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,371 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:43,374 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:43,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:43,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:43,374 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,375 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,375 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,375 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:43,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:43,375 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:43,375 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:43,475 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:43,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:43,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,484 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:43,484 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:43,485 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:43,485 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:43,485 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,486 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,487 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:43,487 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:43,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:43,488 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:43,488 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:43,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,489 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,489 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:43,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:43,489 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:43,490 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:43,496 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:43,496 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:43,496 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:43,921 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051e33e28ca1be4207a7cc5f8c56fc318d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512051e33e28ca1be4207a7cc5f8c56fc318d 2023-11-18 20:53:44,328 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/ecb53aed4a8c4688a96e186d284eaca8 2023-11-18 20:53:44,336 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/ecb53aed4a8c4688a96e186d284eaca8 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8 2023-11-18 20:53:44,343 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 20:53:44,345 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 849ms, sequenceid=17, compaction requested=true 2023-11-18 20:53:44,345 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:44,345 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:44,345 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:44,345 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:44,345 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,345 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:44,345 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:44,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,347 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:44,348 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,348 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:44,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:44,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7195f5a0[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:44,350 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:44,350 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,352 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:44,353 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:44,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:44,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:44,358 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:44,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:44,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:44,360 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:44,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:44,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:44,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,360 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:44,363 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,363 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:44,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,363 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:44,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:44,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:44,364 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:44,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,366 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:44,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:44,370 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:44,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:53:44,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:44,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:44,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,370 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,371 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,371 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:44,371 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:44,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:44,471 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:44,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:44,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:44,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,479 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:44,479 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:44,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:44,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:44,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,482 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,483 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:44,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:44,483 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:44,483 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,484 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:44,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:44,487 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:44,487 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:44,487 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:44,901 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a03df868bbe145ec86a2fd0e44f128ab to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a03df868bbe145ec86a2fd0e44f128ab 2023-11-18 20:53:45,307 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/62c6bb984417468e9ce4786688315c37 2023-11-18 20:53:45,313 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/62c6bb984417468e9ce4786688315c37 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37 2023-11-18 20:53:45,318 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 20:53:45,319 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 832ms, sequenceid=21, compaction requested=true 2023-11-18 20:53:45,319 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:45,319 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:45,319 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:45,319 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:45,319 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:45,320 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:45,321 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,321 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:45,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,322 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:45,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:45,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:45,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f8deb62[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:45,323 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:45,323 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,324 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,324 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:45,324 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:45,325 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:45,325 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,325 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:45,326 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,326 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:45,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:45,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:45,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:45,329 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:45,329 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:45,329 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:45,329 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,329 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:45,332 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,332 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:45,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,332 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:45,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:45,333 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,334 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,337 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,337 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:45,337 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:45,337 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:45,337 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,337 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:45,338 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:45,338 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:45,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:45,338 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,338 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,338 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:45,339 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:45,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:45,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:45,439 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:45,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:45,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:45,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:45,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,446 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:45,446 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:45,446 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:45,446 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:45,447 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,447 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,448 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,448 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:45,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:45,449 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:45,449 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:45,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:45,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,450 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,450 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:45,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:45,450 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:45,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:45,451 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:45,451 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:45,451 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:45,866 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231375fd61123dc44299083d732dc30470d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231375fd61123dc44299083d732dc30470d 2023-11-18 20:53:46,272 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/2098707f41074968b2311489fc08f980 2023-11-18 20:53:46,280 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/2098707f41074968b2311489fc08f980 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980 2023-11-18 20:53:46,285 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 20:53:46,286 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 835ms, sequenceid=25, compaction requested=true 2023-11-18 20:53:46,286 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:46,286 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:46,286 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:46,287 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:46,288 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,288 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:46,289 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,289 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:46,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:46,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24f76999[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:46,290 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:46,291 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,295 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:46,295 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,295 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:46,295 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:46,297 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,297 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:46,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:46,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:46,297 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:46,297 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:46,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:46,300 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:46,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:46,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:46,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,300 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:46,302 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,302 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,302 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:46,302 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:46,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:46,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,304 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:46,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,306 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:46,307 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,307 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:46,307 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:53:46,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:46,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:46,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:46,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:46,307 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:46,307 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:46,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:46,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,308 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,408 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:46,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:46,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:46,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,415 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:46,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:46,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:46,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:46,416 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,416 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,423 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,423 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:46,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:46,423 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:46,424 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,425 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:46,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:46,425 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:46,426 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:46,426 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:46,426 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:46,426 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:46,426 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:46,845 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010139fed578b0c7486299d6c525855e883f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139fed578b0c7486299d6c525855e883f 2023-11-18 20:53:47,250 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/d6fd438e432d4e0eb67543e2a8dc63c0 2023-11-18 20:53:47,257 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/d6fd438e432d4e0eb67543e2a8dc63c0 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0 2023-11-18 20:53:47,262 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 20:53:47,263 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 837ms, sequenceid=29, compaction requested=true 2023-11-18 20:53:47,263 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:47,263 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:47,264 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:47,277 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,277 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,278 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:47,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:47,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ebcfca8[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:47,279 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:47,280 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,331 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,331 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:47,331 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:47,331 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:47,331 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,332 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:47,408 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:47,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:47,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:47,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:47,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:47,412 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:47,412 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:47,412 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:47,412 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,412 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:47,455 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,455 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,456 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:47,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:47,456 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,458 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,523 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,523 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:47,523 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,524 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:47,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:47,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:47,524 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:47,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:47,524 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:47,524 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,524 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:47,525 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,525 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:47,525 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:47,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:47,525 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,625 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:47,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:47,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:47,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,633 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:47,633 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:47,633 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:47,633 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:47,634 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,634 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,677 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,677 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:47,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:47,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:47,678 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:47,678 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:47,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:47,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:47,679 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:47,679 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:47,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:47,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:47,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:47,680 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:47,680 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:47,680 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:47,694 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f55575999a2f4a748ab8397f7a6cf1f3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f55575999a2f4a748ab8397f7a6cf1f3 2023-11-18 20:53:48,101 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/7b5834e59f4449eb81349a8aa2742f49 2023-11-18 20:53:48,107 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/7b5834e59f4449eb81349a8aa2742f49 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49 2023-11-18 20:53:48,113 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 20:53:48,114 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 434ms, sequenceid=33, compaction requested=true 2023-11-18 20:53:48,114 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:48,114 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:48,114 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:48,116 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,116 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,116 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,117 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:48,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@705a242a[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:48,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:48,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,119 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:48,120 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:48,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:48,121 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:48,121 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:48,121 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,121 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:48,125 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:48,125 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:48,125 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:48,125 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:48,125 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,125 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:48,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,128 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,129 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,130 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:48,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:48,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:48,133 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:48,134 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:48,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:48,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:48,234 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:48,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:48,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:48,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:48,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,244 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:48,244 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:48,244 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:48,244 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:48,245 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,245 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,246 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,246 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:48,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:48,247 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,247 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:48,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:48,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,248 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:48,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:48,249 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:48,249 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:48,249 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:48,249 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:48,664 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076409fba5efbc48fca2760be68678b5fe to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509076409fba5efbc48fca2760be68678b5fe 2023-11-18 20:53:48,670 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/903154b603c3419d8745ef077652b996 2023-11-18 20:53:48,676 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/903154b603c3419d8745ef077652b996 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996 2023-11-18 20:53:48,681 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 20:53:48,682 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 433ms, sequenceid=37, compaction requested=true 2023-11-18 20:53:48,682 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:48,683 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:48,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:48,685 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,685 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:48,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20dc07b8[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:48,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:48,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,690 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:48,690 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,690 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:48,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:48,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:48,691 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:48,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:48,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:48,696 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:48,696 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:48,696 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:48,696 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,696 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:48,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:48,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:48,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:48,698 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:48,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:48,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:48,708 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:48,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,709 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,709 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,709 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:48,709 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:48,709 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:48,809 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:48,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:48,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:48,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:48,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,816 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:48,816 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:48,817 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:53:48,817 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:48,817 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,817 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:48,819 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:48,819 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:48,819 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:48,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:48,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,821 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:53:48,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:48,821 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:53:48,821 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:48,822 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:53:48,823 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:48,823 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:48,823 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:48,823 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. started... 2023-11-18 20:53:48,823 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c8a50b8965738f174a5cd6c2d8fd9f7c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:49,244 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120320a074f9d234fb7b1ee10882848b007 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120320a074f9d234fb7b1ee10882848b007 2023-11-18 20:53:49,651 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/36e4c8da59224d32aa86f9855da27d9c 2023-11-18 20:53:49,658 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/36e4c8da59224d32aa86f9855da27d9c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c 2023-11-18 20:53:49,664 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 20:53:49,665 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c8a50b8965738f174a5cd6c2d8fd9f7c in 842ms, sequenceid=41, compaction requested=true 2023-11-18 20:53:49,665 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:49,665 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:53:49,665 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:53:49,667 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:49,668 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,668 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ff8199b[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:49,669 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:49,669 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,670 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,671 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:49,671 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,671 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:49,671 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:53:49,671 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:49,673 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:53:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:49,673 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:53:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:49,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:49,677 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:53:49,677 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:49,677 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:49,677 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,677 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:49,683 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,683 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:49,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,683 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:49,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:49,684 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,686 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:49,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:49,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:49,689 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:49,689 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:49,689 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:49,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-18 20:53:49,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:49,690 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,690 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,690 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:49,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:49,690 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:49,690 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:49,790 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:49,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:49,793 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-18 20:53:49,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:53:49,796 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:53:49,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:49,797 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341429797 2023-11-18 20:53:49,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:53:49,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-18 20:53:49,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:49,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x6ba65eb8 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:53:49,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fd4ee89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:53:49,806 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,253 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c4804c9982cc4532aa9276276a5c2abf to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103c4804c9982cc4532aa9276276a5c2abf 2023-11-18 20:53:50,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,268 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:53:50,270 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:53:50,278 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:53:50,279 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:53:50,291 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3d2723bc81fc4824b1d842e99e0c2e1d first=Optional[r5] last=Optional[r6] 2023-11-18 20:53:50,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3d2723bc81fc4824b1d842e99e0c2e1d}] 2023-11-18 20:53:50,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3d2723bc81fc4824b1d842e99e0c2e1d for inclusion in c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-18 20:53:50,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:50,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:50,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/3d2723bc81fc4824b1d842e99e0c2e1d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qmj058buai5baje14s82q0qjs47rkoghic88mnkcta4mp0s1vvg4lbcrvpt1shav/family1/3d2723bc81fc4824b1d842e99e0c2e1d 2023-11-18 20:53:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qmj058buai5baje14s82q0qjs47rkoghic88mnkcta4mp0s1vvg4lbcrvpt1shav/family1/3d2723bc81fc4824b1d842e99e0c2e1d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_ 2023-11-18 20:53:50,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qmj058buai5baje14s82q0qjs47rkoghic88mnkcta4mp0s1vvg4lbcrvpt1shav/family1/3d2723bc81fc4824b1d842e99e0c2e1d into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_ - updating store file list. 2023-11-18 20:53:50,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_ into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qmj058buai5baje14s82q0qjs47rkoghic88mnkcta4mp0s1vvg4lbcrvpt1shav/family1/3d2723bc81fc4824b1d842e99e0c2e1d into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_) 2023-11-18 20:53:50,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qmj058buai5baje14s82q0qjs47rkoghic88mnkcta4mp0s1vvg4lbcrvpt1shav/family1/3d2723bc81fc4824b1d842e99e0c2e1d 2023-11-18 20:53:50,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:53:50,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:53:50,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): c8a50b8965738f174a5cd6c2d8fd9f7c/family1 is initiating minor compaction 2023-11-18 20:53:50,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3752be93; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:50,318 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c8a50b8965738f174a5cd6c2d8fd9f7c/family1 in testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:50,318 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp, totalSize=49.7 K 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 14072a8b141a440aa0bd7c0d6398c779, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting cae11be616304873a9d1e2be17118277, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ecb53aed4a8c4688a96e186d284eaca8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 62c6bb984417468e9ce4786688315c37, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 2098707f41074968b2311489fc08f980, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:53:50,318 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting d6fd438e432d4e0eb67543e2a8dc63c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:53:50,319 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 7b5834e59f4449eb81349a8aa2742f49, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:53:50,319 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 903154b603c3419d8745ef077652b996, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:53:50,319 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 36e4c8da59224d32aa86f9855da27d9c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:53:50,319 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:53:50,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,324 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:50,327 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139fed578b0c7486299d6c525855e883f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010139fed578b0c7486299d6c525855e883f 2023-11-18 20:53:50,329 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f55575999a2f4a748ab8397f7a6cf1f3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f55575999a2f4a748ab8397f7a6cf1f3 2023-11-18 20:53:50,329 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-18 20:53:50,330 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-18 20:53:50,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,367 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): c8a50b8965738f174a5cd6c2d8fd9f7c#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:53:50,784 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231341e694fe71e4e88879c90d75d92f424 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231341e694fe71e4e88879c90d75d92f424 2023-11-18 20:53:50,785 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/f3e6c331ae1a497ab4b04ea95ef4d76e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f3e6c331ae1a497ab4b04ea95ef4d76e 2023-11-18 20:53:50,785 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,791 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c8a50b8965738f174a5cd6c2d8fd9f7c/family1 of c8a50b8965738f174a5cd6c2d8fd9f7c into f3e6c331ae1a497ab4b04ea95ef4d76e(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:53:50,791 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:50,791 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700340830317; duration=0sec 2023-11-18 20:53:50,792 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:50,811 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5ce70712bea54cab98c45a0ca6d866e8 first=Optional[r1] last=Optional[r4] 2023-11-18 20:53:50,811 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5ce70712bea54cab98c45a0ca6d866e8}] 2023-11-18 20:53:50,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5ce70712bea54cab98c45a0ca6d866e8 for inclusion in c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-18 20:53:50,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:50,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:50,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/5ce70712bea54cab98c45a0ca6d866e8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hhhttf4e0t8f5grs07gfpjmf47vfsp35dib3sb1d8dg97r5hgjobrn30s58fegaq/family1/5ce70712bea54cab98c45a0ca6d866e8 2023-11-18 20:53:50,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hhhttf4e0t8f5grs07gfpjmf47vfsp35dib3sb1d8dg97r5hgjobrn30s58fegaq/family1/5ce70712bea54cab98c45a0ca6d866e8 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_ 2023-11-18 20:53:50,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hhhttf4e0t8f5grs07gfpjmf47vfsp35dib3sb1d8dg97r5hgjobrn30s58fegaq/family1/5ce70712bea54cab98c45a0ca6d866e8 into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_ - updating store file list. 2023-11-18 20:53:50,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_ into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hhhttf4e0t8f5grs07gfpjmf47vfsp35dib3sb1d8dg97r5hgjobrn30s58fegaq/family1/5ce70712bea54cab98c45a0ca6d866e8 into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_) 2023-11-18 20:53:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__hhhttf4e0t8f5grs07gfpjmf47vfsp35dib3sb1d8dg97r5hgjobrn30s58fegaq/family1/5ce70712bea54cab98c45a0ca6d866e8 2023-11-18 20:53:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:53:50,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:53:50,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): c8a50b8965738f174a5cd6c2d8fd9f7c/family1 is initiating minor compaction (all files) 2023-11-18 20:53:50,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30cb36e0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:50,826 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c8a50b8965738f174a5cd6c2d8fd9f7c/family1 in testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:53:50,827 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f3e6c331ae1a497ab4b04ea95ef4d76e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp, totalSize=178.1 K 2023-11-18 20:53:50,827 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ae6d53691a264a61b47cceed82dadf31, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:53:50,828 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f3e6c331ae1a497ab4b04ea95ef4d76e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:53:50,828 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965226804 2023-11-18 20:53:50,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:50,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb44b309d7d2403ba1d0d1a6fe1e4a87 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201cb44b309d7d2403ba1d0d1a6fe1e4a87 2023-11-18 20:53:50,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512051e33e28ca1be4207a7cc5f8c56fc318d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512051e33e28ca1be4207a7cc5f8c56fc318d 2023-11-18 20:53:50,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a03df868bbe145ec86a2fd0e44f128ab to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228a03df868bbe145ec86a2fd0e44f128ab 2023-11-18 20:53:50,836 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231375fd61123dc44299083d732dc30470d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231375fd61123dc44299083d732dc30470d 2023-11-18 20:53:50,836 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-18 20:53:50,836 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-18 20:53:50,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,848 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): c8a50b8965738f174a5cd6c2d8fd9f7c#family1#compaction#23 average throughput is 17.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:53:50,875 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_] to archive 2023-11-18 20:53:50,876 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:50,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/14072a8b141a440aa0bd7c0d6398c779 2023-11-18 20:53:50,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/cae11be616304873a9d1e2be17118277 2023-11-18 20:53:50,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ecb53aed4a8c4688a96e186d284eaca8 2023-11-18 20:53:50,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/62c6bb984417468e9ce4786688315c37 2023-11-18 20:53:50,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/2098707f41074968b2311489fc08f980 2023-11-18 20:53:50,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/d6fd438e432d4e0eb67543e2a8dc63c0 2023-11-18 20:53:50,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/7b5834e59f4449eb81349a8aa2742f49 2023-11-18 20:53:50,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/903154b603c3419d8745ef077652b996 2023-11-18 20:53:50,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/36e4c8da59224d32aa86f9855da27d9c 2023-11-18 20:53:50,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/875a712b174b4aedbd1cd0e77ac008d3_SeqId_44_ 2023-11-18 20:53:50,917 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309b190e5e57b0479e9cf53335c7e0aee8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511309b190e5e57b0479e9cf53335c7e0aee8 2023-11-18 20:53:50,921 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,949 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abc462e44cc94b5b8d0a1ba010618689 first=Optional[r00] last=Optional[r8] 2023-11-18 20:53:50,949 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abc462e44cc94b5b8d0a1ba010618689}] 2023-11-18 20:53:50,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abc462e44cc94b5b8d0a1ba010618689 for inclusion in c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-18 20:53:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:53:50,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:50,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/abc462e44cc94b5b8d0a1ba010618689 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rf7nff2ptg5q5tnml798f2hv3sumlrt57fg6rcj37cqom1k6d9t08crpcbqd16s1/family1/abc462e44cc94b5b8d0a1ba010618689 2023-11-18 20:53:50,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rf7nff2ptg5q5tnml798f2hv3sumlrt57fg6rcj37cqom1k6d9t08crpcbqd16s1/family1/abc462e44cc94b5b8d0a1ba010618689 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/5c9697ed840248eeab387f2b12740a56_SeqId_49_ 2023-11-18 20:53:50,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rf7nff2ptg5q5tnml798f2hv3sumlrt57fg6rcj37cqom1k6d9t08crpcbqd16s1/family1/abc462e44cc94b5b8d0a1ba010618689 into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/5c9697ed840248eeab387f2b12740a56_SeqId_49_ - updating store file list. 2023-11-18 20:53:50,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/5c9697ed840248eeab387f2b12740a56_SeqId_49_ into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 2023-11-18 20:53:50,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rf7nff2ptg5q5tnml798f2hv3sumlrt57fg6rcj37cqom1k6d9t08crpcbqd16s1/family1/abc462e44cc94b5b8d0a1ba010618689 into c8a50b8965738f174a5cd6c2d8fd9f7c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/5c9697ed840248eeab387f2b12740a56_SeqId_49_) 2023-11-18 20:53:50,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__rf7nff2ptg5q5tnml798f2hv3sumlrt57fg6rcj37cqom1k6d9t08crpcbqd16s1/family1/abc462e44cc94b5b8d0a1ba010618689 2023-11-18 20:53:50,966 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:50,968 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120320a074f9d234fb7b1ee10882848b007 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120320a074f9d234fb7b1ee10882848b007 2023-11-18 20:53:50,970 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287a6685b9beb7454eb7655e18feb04d75 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511287a6685b9beb7454eb7655e18feb04d75 2023-11-18 20:53:50,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130e37584811aa142e38b4b0370a56dea90 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130e37584811aa142e38b4b0370a56dea90 2023-11-18 20:53:50,971 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-18 20:53:50,971 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 20:53:50,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,971 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:53:50,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:53:50,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:53:50,972 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:53:50,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.1780 sec 2023-11-18 20:53:51,076 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=262 (was 252) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x6ba65eb8-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: PacketResponder: BP-716673243-172.31.14.131-1700340798252:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53752 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53910 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-716673243-172.31.14.131-1700340798252:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-239664644_17 at /127.0.0.1:53870 [Receiving block BP-716673243-172.31.14.131-1700340798252:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123139a74f23a7954ffd9629a09614b0101e java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53834 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x732a1a32-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x732a1a32-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53610 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-239664644_17 at /127.0.0.1:53794 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53812 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53740 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53706 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53808 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x6ba65eb8-SendThread(127.0.0.1:55479) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53676 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53760 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-239664644_17 at /127.0.0.1:53644 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53800 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53828 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53768 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53732 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:55479@0x6ba65eb8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/322049390.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/f4fde031929043848ed014e87794e0df block BP-716673243-172.31.14.131-1700340798252:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:50612 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6592b94-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53782 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1663820141_17 at /127.0.0.1:53700 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=636 (was 618) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=262 (was 282), ProcessCount=172 (was 172), AvailableMemoryMB=20528 (was 20716) 2023-11-18 20:53:51,091 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=262, ProcessCount=172, AvailableMemoryMB=20526 2023-11-18 20:53:51,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:53:51,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:51,097 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:53:51,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-18 20:53:51,098 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:53:51,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:51,099 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:51,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29 empty. 2023-11-18 20:53:51,100 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:51,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-18 20:53:51,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:51,282 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/.tmp/family1/f4fde031929043848ed014e87794e0df as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f4fde031929043848ed014e87794e0df 2023-11-18 20:53:51,289 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c8a50b8965738f174a5cd6c2d8fd9f7c/family1 of c8a50b8965738f174a5cd6c2d8fd9f7c into f4fde031929043848ed014e87794e0df(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:53:51,289 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:53:51,289 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700340830826; duration=0sec 2023-11-18 20:53:51,289 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:53:51,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f3e6c331ae1a497ab4b04ea95ef4d76e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_] to archive 2023-11-18 20:53:51,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:53:51,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/ae6d53691a264a61b47cceed82dadf31 2023-11-18 20:53:51,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f3e6c331ae1a497ab4b04ea95ef4d76e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/f3e6c331ae1a497ab4b04ea95ef4d76e 2023-11-18 20:53:51,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/family1/08393f8f6cf54ff6a94a8e32fb299d0e_SeqId_47_ 2023-11-18 20:53:51,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:51,517 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 20:53:51,518 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => d737c5e6ff00cde1f3ca73b85b854a29, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:53:51,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing d737c5e6ff00cde1f3ca73b85b854a29, disabling compactions & flushes 2023-11-18 20:53:51,925 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. after waiting 0 ms 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:51,925 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:51,925 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:51,928 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:53:51,929 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340831929"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340831929"}]},"ts":"1700340831929"} 2023-11-18 20:53:51,930 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:53:51,931 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:53:51,932 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340831931"}]},"ts":"1700340831931"} 2023-11-18 20:53:51,933 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-18 20:53:51,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=d737c5e6ff00cde1f3ca73b85b854a29, ASSIGN}] 2023-11-18 20:53:51,938 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=d737c5e6ff00cde1f3ca73b85b854a29, ASSIGN 2023-11-18 20:53:51,938 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=d737c5e6ff00cde1f3ca73b85b854a29, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:53:52,089 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=d737c5e6ff00cde1f3ca73b85b854a29, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:52,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340832089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340832089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340832089"}]},"ts":"1700340832089"} 2023-11-18 20:53:52,092 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure d737c5e6ff00cde1f3ca73b85b854a29, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:53:52,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:52,244 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:52,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:52,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d737c5e6ff00cde1f3ca73b85b854a29, NAME => 'testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:53:52,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:53:52,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,250 INFO [StoreOpener-d737c5e6ff00cde1f3ca73b85b854a29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,252 DEBUG [StoreOpener-d737c5e6ff00cde1f3ca73b85b854a29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:53:52,253 DEBUG [StoreOpener-d737c5e6ff00cde1f3ca73b85b854a29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:53:52,253 INFO [StoreOpener-d737c5e6ff00cde1f3ca73b85b854a29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d737c5e6ff00cde1f3ca73b85b854a29 columnFamilyName family1 2023-11-18 20:53:52,255 INFO [StoreOpener-d737c5e6ff00cde1f3ca73b85b854a29-1] regionserver.HStore(310): Store=d737c5e6ff00cde1f3ca73b85b854a29/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:53:52,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:53:52,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:53:52,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d737c5e6ff00cde1f3ca73b85b854a29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65537351, jitterRate=-0.023417368531227112}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:53:52,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:52,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29., pid=25, masterSystemTime=1700340832244 2023-11-18 20:53:52,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:52,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:52,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=d737c5e6ff00cde1f3ca73b85b854a29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:52,265 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340832265"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340832265"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340832265"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340832265"}]},"ts":"1700340832265"} 2023-11-18 20:53:52,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-18 20:53:52,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure d737c5e6ff00cde1f3ca73b85b854a29, server=jenkins-hbase4.apache.org,32871,1700340802897 in 174 msec 2023-11-18 20:53:52,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-18 20:53:52,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=d737c5e6ff00cde1f3ca73b85b854a29, ASSIGN in 332 msec 2023-11-18 20:53:52,271 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:53:52,272 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340832271"}]},"ts":"1700340832271"} 2023-11-18 20:53:52,273 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-18 20:53:52,275 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:53:52,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1810 sec 2023-11-18 20:53:53,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-18 20:53:53,204 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-18 20:53:53,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:53,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,228 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:53,228 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:53,228 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:53,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:53,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,231 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:53,231 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:53,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:53,231 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,231 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:53,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:53,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,232 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:53,233 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:53,233 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:53,233 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:53,234 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:53:53,651 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306b19cf10e01c4f8b87e1d8d1cecdc009 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511306b19cf10e01c4f8b87e1d8d1cecdc009 2023-11-18 20:53:53,654 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/5474e3156def4cb7965df8a0b8b780a0 2023-11-18 20:53:53,659 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/5474e3156def4cb7965df8a0b8b780a0 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0 2023-11-18 20:53:53,664 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-18 20:53:53,665 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 431ms, sequenceid=5, compaction requested=false 2023-11-18 20:53:53,665 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:53,666 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:53,666 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:53,666 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:53,666 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:53,666 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,666 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:53,666 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:53,669 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,669 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:53,670 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:53,670 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:53,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:53,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e8eb70[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:53,671 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:53,671 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,673 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:53,673 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:53,673 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,673 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:53,676 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:53,676 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:53,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:53,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:53,678 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:53,678 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:53,678 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:53,678 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,678 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:53,680 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,680 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:53,680 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:53,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:53,680 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:53,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,682 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:53,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:53,684 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:53,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:53,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:53,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:53,684 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,685 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,685 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,685 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:53,685 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:53,685 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:53,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:53,785 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:53,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:53,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,792 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:53,792 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,793 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,795 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:53,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:53,795 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:53,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:53,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,796 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,796 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:53,796 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:53,796 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:53,796 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:53,796 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:53,799 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:53,799 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:53,799 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:53,799 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:53:54,212 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fbe3ebe43fa64c2ca5c30199ac6457c2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128fbe3ebe43fa64c2ca5c30199ac6457c2 2023-11-18 20:53:54,618 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/433c207b92c84a77815e12c4f910c1b1 2023-11-18 20:53:54,625 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/433c207b92c84a77815e12c4f910c1b1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1 2023-11-18 20:53:54,629 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:53:54,631 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 831ms, sequenceid=9, compaction requested=false 2023-11-18 20:53:54,631 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:54,631 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:54,631 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:54,637 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,637 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,638 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,638 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:54,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5732faf3[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:54,639 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:54,639 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,641 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,641 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,641 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:54,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:54,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:54,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:54,643 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,643 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:54,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:54,646 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:54,646 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:54,646 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:54,646 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,646 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:54,648 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,648 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,648 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:54,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:54,649 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,650 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:54,653 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:54,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:54,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:54,653 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,654 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,654 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:54,654 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:54,654 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:54,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:54,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:54,754 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:54,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:54,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:54,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:54,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,761 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:54,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:54,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:54,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:54,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,762 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,763 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,763 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:54,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:54,763 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,763 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:54,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,764 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:54,765 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:54,765 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:54,765 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:54,765 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:54,765 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:54,765 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:54,765 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:54,781 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ce6484b7416e4c249fdb218a56e24742 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ce6484b7416e4c249fdb218a56e24742 2023-11-18 20:53:54,787 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/788ea3fbbcdb438eb81621add26adadb 2023-11-18 20:53:54,791 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/788ea3fbbcdb438eb81621add26adadb as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb 2023-11-18 20:53:54,796 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 20:53:54,797 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 32ms, sequenceid=13, compaction requested=true 2023-11-18 20:53:54,797 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:54,797 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:54,797 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:54,799 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,799 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:54,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1713d66a[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:54,801 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:54,801 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,802 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:54,802 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,802 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:54,802 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:54,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:54,804 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:54,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:54,807 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:54,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:54,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:54,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,807 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:54,809 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,809 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:54,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,809 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:54,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:54,809 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,811 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:54,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:54,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:54,813 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:54,813 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:54,814 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:54,814 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:54,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:54,914 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:54,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:54,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:54,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:54,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,920 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:54,920 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:54,921 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:54,921 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:54,921 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,921 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,922 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,922 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:54,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:54,923 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:54,923 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:54,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:54,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:54,924 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:54,924 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:54,924 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:54,924 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:54,924 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:54,924 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:54,924 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:54,924 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:55,338 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a7a3ebf4a3ce45549c01111182e263a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a7a3ebf4a3ce45549c01111182e263a3 2023-11-18 20:53:55,744 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/f76e09ac00144f7eb0d328ecbf751947 2023-11-18 20:53:55,750 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/f76e09ac00144f7eb0d328ecbf751947 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947 2023-11-18 20:53:55,754 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 20:53:55,755 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 831ms, sequenceid=17, compaction requested=true 2023-11-18 20:53:55,755 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:55,755 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:55,758 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,758 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,759 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:55,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:55,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685831d2[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:55,760 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:55,760 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,761 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,761 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:55,761 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:55,761 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:55,761 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,762 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:55,763 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:55,763 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:55,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:55,765 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:55,766 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:55,766 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:55,766 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,766 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:55,767 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,767 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,768 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:55,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:55,768 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,769 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:55,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:55,777 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:55,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:55,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:55,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,777 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,778 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:55,778 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:55,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:55,878 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:55,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:55,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:55,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:55,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,884 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:55,884 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:55,884 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:55,884 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:55,885 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,885 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,886 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:55,886 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:55,886 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:55,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,886 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:55,887 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,887 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:55,887 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:55,887 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:55,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:55,888 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:55,888 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:55,888 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:56,301 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285a8efd24c3904460897851e92c735cff to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285a8efd24c3904460897851e92c735cff 2023-11-18 20:53:56,707 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/938293ec864941f1b2c37ca21637d6a0 2023-11-18 20:53:56,712 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/938293ec864941f1b2c37ca21637d6a0 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0 2023-11-18 20:53:56,717 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 20:53:56,718 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 830ms, sequenceid=21, compaction requested=true 2023-11-18 20:53:56,718 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:56,718 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:56,718 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:56,719 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:56,721 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,721 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:56,721 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,721 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:56,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:56,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@595af4c2[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:56,723 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:56,723 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,724 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:56,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:56,724 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:56,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:56,727 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:56,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:56,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:56,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:56,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:56,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:56,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:56,730 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:56,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:56,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:56,730 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,730 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:56,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:56,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,732 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:56,732 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:56,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:56,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,734 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:56,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,736 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,736 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:56,736 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,737 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:56,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:56,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:56,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:56,837 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:56,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:56,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:56,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:56,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,844 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:56,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:56,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:56,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:56,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,846 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:56,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:56,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:56,846 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:56,846 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:56,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:56,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,847 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:56,847 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:56,847 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:56,847 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:56,847 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:56,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:56,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:56,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:56,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:56,848 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:57,262 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317ad71b0c41004486b736d7fccb6ae2ec to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317ad71b0c41004486b736d7fccb6ae2ec 2023-11-18 20:53:57,668 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/8afd2329f4364233829252988ff6a075 2023-11-18 20:53:57,674 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/8afd2329f4364233829252988ff6a075 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075 2023-11-18 20:53:57,679 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 20:53:57,680 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 832ms, sequenceid=25, compaction requested=true 2023-11-18 20:53:57,680 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:57,680 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:57,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:57,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:57,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:57,680 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:57,683 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:57,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:57,684 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,684 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:57,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:57,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:57,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:57,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:57,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@197f7878[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:57,685 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:57,686 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,687 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:57,687 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:57,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:57,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,688 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:57,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:57,688 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:57,688 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:57,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:57,691 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:57,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:57,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:57,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,691 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:57,692 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,692 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:57,692 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:57,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:57,693 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:57,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:57,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:57,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:57,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:57,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:57,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:57,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:57,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:53:57,698 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:57,698 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,699 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:57,775 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:53:57,799 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:57,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:57,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,806 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:57,806 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:57,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:57,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:57,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,807 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,808 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:57,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:57,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:57,809 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:57,809 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:57,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:57,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,810 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,810 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:57,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:57,810 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:57,810 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:57,810 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:57,811 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:58,225 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010130011e75ce254636b7aa9033a4c9b9ff to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010130011e75ce254636b7aa9033a4c9b9ff 2023-11-18 20:53:58,630 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/37958515d92949048a311ab3ef8e82da 2023-11-18 20:53:58,636 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/37958515d92949048a311ab3ef8e82da as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da 2023-11-18 20:53:58,640 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 20:53:58,641 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 830ms, sequenceid=29, compaction requested=true 2023-11-18 20:53:58,641 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:58,641 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,641 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:58,642 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:58,643 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,643 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:58,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:58,644 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:58,644 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:58,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:58,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10d64dbb[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:58,645 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:58,645 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,646 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,646 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:58,646 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:58,646 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:58,646 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,646 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:58,651 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:58,651 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,651 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,651 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:58,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:58,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:58,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:58,654 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:58,654 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:58,654 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:58,654 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,654 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:58,655 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,655 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,655 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:58,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:58,656 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:58,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,657 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,659 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,659 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:58,659 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:58,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:58,660 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:58,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:53:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:58,660 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:58,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:58,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,660 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,760 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:58,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:58,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:58,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:58,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,767 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:58,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:58,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:58,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:58,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,767 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,768 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,769 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:58,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:58,769 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:58,769 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,770 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,770 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:58,770 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:58,770 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:58,770 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:58,770 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:53:59,183 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010311693140c9b641288bb9ad3a1636a6e9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311693140c9b641288bb9ad3a1636a6e9 2023-11-18 20:53:59,589 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/1b17040bb7ac4ed5b176d5e4f00a549d 2023-11-18 20:53:59,594 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/1b17040bb7ac4ed5b176d5e4f00a549d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d 2023-11-18 20:53:59,598 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 20:53:59,598 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 828ms, sequenceid=33, compaction requested=true 2023-11-18 20:53:59,599 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:53:59,599 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:53:59,599 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:53:59,602 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,602 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:59,602 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,602 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:59,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:59,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:53:59,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@392928d2[Count = 0] remaining members to acquire global barrier 2023-11-18 20:53:59,603 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:53:59,603 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,605 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,605 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:53:59,605 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:53:59,605 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:53:59,605 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,605 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:53:59,606 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,606 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:53:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:59,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:59,606 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:59,606 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:53:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:53:59,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:53:59,609 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:53:59,609 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:53:59,609 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:53:59,609 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,609 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:53:59,611 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,611 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,611 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:53:59,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:59,611 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:53:59,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:53:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,612 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:53:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:53:59,616 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:53:59,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:53:59,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:59,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:59,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:53:59,616 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:53:59,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:53:59,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:53:59,717 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:53:59,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:53:59,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:53:59,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:53:59,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,723 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:53:59,723 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:59,723 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:53:59,723 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:53:59,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,733 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:53:59,733 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:53:59,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:53:59,733 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:53:59,733 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:53:59,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:53:59,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:53:59,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:53:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:53:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:53:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:53:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:53:59,735 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:53:59,735 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:53:59,735 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:53:59,735 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:00,148 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075983fdc792ca4945974c3bf5cb38d0ea to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509075983fdc792ca4945974c3bf5cb38d0ea 2023-11-18 20:54:00,553 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/d9709c2e83774865b10283cbc435c11c 2023-11-18 20:54:00,558 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/d9709c2e83774865b10283cbc435c11c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c 2023-11-18 20:54:00,563 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 20:54:00,563 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 828ms, sequenceid=37, compaction requested=true 2023-11-18 20:54:00,564 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:00,564 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:54:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:00,564 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:00,566 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,566 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:00,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:00,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@375b27d1[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:00,568 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:00,568 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,569 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:00,569 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:00,569 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,569 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:00,575 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:00,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:00,578 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:00,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:00,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:00,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,578 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:00,579 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,579 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:00,579 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:00,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:00,580 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:00,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:54:00,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,584 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:00,584 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,585 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,585 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,684 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:00,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:00,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:00,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,691 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:54:00,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:00,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:00,691 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:00,692 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,692 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,693 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:00,693 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:00,693 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:00,693 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,694 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,694 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:00,694 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:00,694 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:00,694 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:00,695 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:00,695 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:54:00,695 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. started... 2023-11-18 20:54:00,695 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing d737c5e6ff00cde1f3ca73b85b854a29 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:01,114 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120049c15012c15455491a43df1648d3aad to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120049c15012c15455491a43df1648d3aad 2023-11-18 20:54:01,520 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/d9d92e5e184b465990e252929ab4e019 2023-11-18 20:54:01,525 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/d9d92e5e184b465990e252929ab4e019 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019 2023-11-18 20:54:01,530 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 20:54:01,531 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d737c5e6ff00cde1f3ca73b85b854a29 in 835ms, sequenceid=41, compaction requested=true 2023-11-18 20:54:01,531 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:01,531 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:54:01,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:01,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:01,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:01,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:01,540 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,540 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:01,541 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,541 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:01,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:01,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@558525fa[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:01,542 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:01,542 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,543 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,543 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:01,543 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:01,543 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:01,543 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,543 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:01,545 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:01,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:01,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:01,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:01,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:01,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:01,547 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:01,547 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:01,547 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:01,547 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,547 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:01,549 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,549 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:01,549 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:01,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:01,549 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,551 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,554 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,554 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:01,554 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:01,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-18 20:54:01,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:01,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:01,554 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:01,554 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,554 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:01,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:01,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:01,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,655 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:01,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:01,658 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-18 20:54:01,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:01,660 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:01,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:01,661 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341441661 2023-11-18 20:54:01,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:54:01,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-18 20:54:01,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:01,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x4c20758e to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:01,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74387a25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:01,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,110 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038146526eb53b448e8ebabeab98a61741 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038146526eb53b448e8ebabeab98a61741 2023-11-18 20:54:02,111 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:02,124 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:02,125 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:02,131 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:02,132 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:02,141 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b26d4ae6972d45328c847be72013e61d first=Optional[r3] last=Optional[r6] 2023-11-18 20:54:02,141 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b26d4ae6972d45328c847be72013e61d}] 2023-11-18 20:54:02,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b26d4ae6972d45328c847be72013e61d for inclusion in d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:54:02,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 20:54:02,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:02,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:02,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b26d4ae6972d45328c847be72013e61d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__umta7gu6hdpqmfmqmr27vi34bksvlusmv7ebpd53uvqqdc0707558fe54v3s0nq/family1/b26d4ae6972d45328c847be72013e61d 2023-11-18 20:54:02,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__umta7gu6hdpqmfmqmr27vi34bksvlusmv7ebpd53uvqqdc0707558fe54v3s0nq/family1/b26d4ae6972d45328c847be72013e61d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_ 2023-11-18 20:54:02,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__umta7gu6hdpqmfmqmr27vi34bksvlusmv7ebpd53uvqqdc0707558fe54v3s0nq/family1/b26d4ae6972d45328c847be72013e61d into d737c5e6ff00cde1f3ca73b85b854a29/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_ - updating store file list. 2023-11-18 20:54:02,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_ into d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:54:02,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__umta7gu6hdpqmfmqmr27vi34bksvlusmv7ebpd53uvqqdc0707558fe54v3s0nq/family1/b26d4ae6972d45328c847be72013e61d into d737c5e6ff00cde1f3ca73b85b854a29/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_) 2023-11-18 20:54:02,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__umta7gu6hdpqmfmqmr27vi34bksvlusmv7ebpd53uvqqdc0707558fe54v3s0nq/family1/b26d4ae6972d45328c847be72013e61d 2023-11-18 20:54:02,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:54:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:54:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): d737c5e6ff00cde1f3ca73b85b854a29/family1 is initiating minor compaction 2023-11-18 20:54:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2594f028; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:02,162 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d737c5e6ff00cde1f3ca73b85b854a29/family1 in testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:54:02,162 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp, totalSize=50.0 K 2023-11-18 20:54:02,162 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 433c207b92c84a77815e12c4f910c1b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:54:02,162 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 788ea3fbbcdb438eb81621add26adadb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:54:02,162 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f76e09ac00144f7eb0d328ecbf751947, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:54:02,162 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 938293ec864941f1b2c37ca21637d6a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 8afd2329f4364233829252988ff6a075, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 37958515d92949048a311ab3ef8e82da, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 1b17040bb7ac4ed5b176d5e4f00a549d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting d9709c2e83774865b10283cbc435c11c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting d9d92e5e184b465990e252929ab4e019, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:54:02,163 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 692207844be543718bc9f2959e9a3c15_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:54:02,164 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:02,165 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:02,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285a8efd24c3904460897851e92c735cff to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512285a8efd24c3904460897851e92c735cff 2023-11-18 20:54:02,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317ad71b0c41004486b736d7fccb6ae2ec to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512317ad71b0c41004486b736d7fccb6ae2ec 2023-11-18 20:54:02,169 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010130011e75ce254636b7aa9033a4c9b9ff to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010130011e75ce254636b7aa9033a4c9b9ff 2023-11-18 20:54:02,170 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311693140c9b641288bb9ad3a1636a6e9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010311693140c9b641288bb9ad3a1636a6e9 2023-11-18 20:54:02,171 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-18 20:54:02,171 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 20:54:02,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,171 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:02,188 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): d737c5e6ff00cde1f3ca73b85b854a29#family1#compaction#34 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:03,006 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a2ce40ff1f6a4c729996c30a35c3a3d0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a2ce40ff1f6a4c729996c30a35c3a3d0 2023-11-18 20:54:03,007 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:03,007 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/1ec7020bd04440a292c7800fe1082956 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1ec7020bd04440a292c7800fe1082956 2023-11-18 20:54:03,012 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d737c5e6ff00cde1f3ca73b85b854a29/family1 of d737c5e6ff00cde1f3ca73b85b854a29 into 1ec7020bd04440a292c7800fe1082956(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:03,012 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:03,013 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700340842162; duration=0sec 2023-11-18 20:54:03,013 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:03,032 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8c770062181a4f2b8b8a25885b789f86 first=Optional[r1] last=Optional[r2] 2023-11-18 20:54:03,032 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8c770062181a4f2b8b8a25885b789f86}] 2023-11-18 20:54:03,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8c770062181a4f2b8b8a25885b789f86 for inclusion in d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:54:03,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-18 20:54:03,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:03,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:03,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8c770062181a4f2b8b8a25885b789f86 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0ov1mn4b2otplje1mlc1i5v5dbr7h34a2pu2lhpci1aqujg1l5op58j153kk0dd/family1/8c770062181a4f2b8b8a25885b789f86 2023-11-18 20:54:03,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0ov1mn4b2otplje1mlc1i5v5dbr7h34a2pu2lhpci1aqujg1l5op58j153kk0dd/family1/8c770062181a4f2b8b8a25885b789f86 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_ 2023-11-18 20:54:03,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0ov1mn4b2otplje1mlc1i5v5dbr7h34a2pu2lhpci1aqujg1l5op58j153kk0dd/family1/8c770062181a4f2b8b8a25885b789f86 into d737c5e6ff00cde1f3ca73b85b854a29/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_ - updating store file list. 2023-11-18 20:54:03,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_ into d737c5e6ff00cde1f3ca73b85b854a29/family1 2023-11-18 20:54:03,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0ov1mn4b2otplje1mlc1i5v5dbr7h34a2pu2lhpci1aqujg1l5op58j153kk0dd/family1/8c770062181a4f2b8b8a25885b789f86 into d737c5e6ff00cde1f3ca73b85b854a29/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_) 2023-11-18 20:54:03,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__i0ov1mn4b2otplje1mlc1i5v5dbr7h34a2pu2lhpci1aqujg1l5op58j153kk0dd/family1/8c770062181a4f2b8b8a25885b789f86 2023-11-18 20:54:03,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:54:03,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:54:03,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): d737c5e6ff00cde1f3ca73b85b854a29/family1 is initiating minor compaction (all files) 2023-11-18 20:54:03,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2bfad6b1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:03,047 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d737c5e6ff00cde1f3ca73b85b854a29/family1 in testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:54:03,047 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1ec7020bd04440a292c7800fe1082956, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp, totalSize=176.8 K 2023-11-18 20:54:03,048 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 5474e3156def4cb7965df8a0b8b780a0, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:54:03,048 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 1ec7020bd04440a292c7800fe1082956, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:54:03,049 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 619c5804d9084dd183fb872167286e15_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965226804 2023-11-18 20:54:03,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:03,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:03,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ce6484b7416e4c249fdb218a56e24742 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ce6484b7416e4c249fdb218a56e24742 2023-11-18 20:54:03,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a7a3ebf4a3ce45549c01111182e263a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a7a3ebf4a3ce45549c01111182e263a3 2023-11-18 20:54:03,052 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-18 20:54:03,053 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 20:54:03,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:03,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:03,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:03,054 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:03,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.3960 sec 2023-11-18 20:54:03,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_] to archive 2023-11-18 20:54:03,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:03,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/433c207b92c84a77815e12c4f910c1b1 2023-11-18 20:54:03,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/788ea3fbbcdb438eb81621add26adadb 2023-11-18 20:54:03,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/f76e09ac00144f7eb0d328ecbf751947 2023-11-18 20:54:03,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/938293ec864941f1b2c37ca21637d6a0 2023-11-18 20:54:03,074 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): d737c5e6ff00cde1f3ca73b85b854a29#family1#compaction#35 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:03,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/8afd2329f4364233829252988ff6a075 2023-11-18 20:54:03,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/37958515d92949048a311ab3ef8e82da 2023-11-18 20:54:03,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1b17040bb7ac4ed5b176d5e4f00a549d 2023-11-18 20:54:03,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9709c2e83774865b10283cbc435c11c 2023-11-18 20:54:03,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/d9d92e5e184b465990e252929ab4e019 2023-11-18 20:54:03,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/692207844be543718bc9f2959e9a3c15_SeqId_44_ 2023-11-18 20:54:03,098 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-11-18 20:54:03,163 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 262), OpenFileDescriptor=641 (was 636) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=218 (was 262), ProcessCount=172 (was 172), AvailableMemoryMB=20437 (was 20526) 2023-11-18 20:54:03,173 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=218, ProcessCount=172, AvailableMemoryMB=20436 2023-11-18 20:54:03,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 20:54:03,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:03,178 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:03,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-18 20:54:03,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba empty. 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1 empty. 2023-11-18 20:54:03,181 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339 empty. 2023-11-18 20:54:03,182 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:03,182 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:03,182 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:03,182 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-18 20:54:03,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:03,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:03,595 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:03,597 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 44802116890a24c27ebbbeb23abd6339, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:03,597 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88111fc5afdd533d61a509691718eaba, NAME => 'testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:03,597 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4308691617d157c7aa4b029ae95cc8d1, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:03,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:03,900 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/.tmp/family1/fce48422518047c98231d61a8acd9626 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/fce48422518047c98231d61a8acd9626 2023-11-18 20:54:03,906 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d737c5e6ff00cde1f3ca73b85b854a29/family1 of d737c5e6ff00cde1f3ca73b85b854a29 into fce48422518047c98231d61a8acd9626(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:03,906 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:54:03,906 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1700340843047; duration=0sec 2023-11-18 20:54:03,906 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:03,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1ec7020bd04440a292c7800fe1082956, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_] to archive 2023-11-18 20:54:03,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:03,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/5474e3156def4cb7965df8a0b8b780a0 2023-11-18 20:54:03,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1ec7020bd04440a292c7800fe1082956 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/1ec7020bd04440a292c7800fe1082956 2023-11-18 20:54:03,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/family1/619c5804d9084dd183fb872167286e15_SeqId_47_ 2023-11-18 20:54:04,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,003 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 4308691617d157c7aa4b029ae95cc8d1, disabling compactions & flushes 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. after waiting 0 ms 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 88111fc5afdd533d61a509691718eaba, disabling compactions & flushes 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 4308691617d157c7aa4b029ae95cc8d1: 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. after waiting 0 ms 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 88111fc5afdd533d61a509691718eaba: 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 44802116890a24c27ebbbeb23abd6339, disabling compactions & flushes 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. after waiting 0 ms 2023-11-18 20:54:04,004 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,004 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,005 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:04,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:04,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700340844008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340844008"}]},"ts":"1700340844008"} 2023-11-18 20:54:04,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340844008"}]},"ts":"1700340844008"} 2023-11-18 20:54:04,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844008"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340844008"}]},"ts":"1700340844008"} 2023-11-18 20:54:04,010 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 20:54:04,011 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:04,011 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340844011"}]},"ts":"1700340844011"} 2023-11-18 20:54:04,013 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-18 20:54:04,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=88111fc5afdd533d61a509691718eaba, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4308691617d157c7aa4b029ae95cc8d1, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=44802116890a24c27ebbbeb23abd6339, ASSIGN}] 2023-11-18 20:54:04,017 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4308691617d157c7aa4b029ae95cc8d1, ASSIGN 2023-11-18 20:54:04,017 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=88111fc5afdd533d61a509691718eaba, ASSIGN 2023-11-18 20:54:04,018 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=44802116890a24c27ebbbeb23abd6339, ASSIGN 2023-11-18 20:54:04,018 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4308691617d157c7aa4b029ae95cc8d1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:04,018 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=88111fc5afdd533d61a509691718eaba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:04,018 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=44802116890a24c27ebbbeb23abd6339, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:04,170 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=44802116890a24c27ebbbeb23abd6339, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4308691617d157c7aa4b029ae95cc8d1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=88111fc5afdd533d61a509691718eaba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,170 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340844170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340844170"}]},"ts":"1700340844170"} 2023-11-18 20:54:04,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700340844170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340844170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340844170"}]},"ts":"1700340844170"} 2023-11-18 20:54:04,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844170"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340844170"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340844170"}]},"ts":"1700340844170"} 2023-11-18 20:54:04,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 44802116890a24c27ebbbeb23abd6339, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:04,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 4308691617d157c7aa4b029ae95cc8d1, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:04,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 88111fc5afdd533d61a509691718eaba, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:04,324 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4308691617d157c7aa4b029ae95cc8d1, NAME => 'testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 20:54:04,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,329 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,330 DEBUG [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/family1 2023-11-18 20:54:04,330 DEBUG [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/family1 2023-11-18 20:54:04,331 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4308691617d157c7aa4b029ae95cc8d1 columnFamilyName family1 2023-11-18 20:54:04,332 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] regionserver.HStore(310): Store=4308691617d157c7aa4b029ae95cc8d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,333 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,334 DEBUG [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/family2 2023-11-18 20:54:04,334 DEBUG [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/family2 2023-11-18 20:54:04,335 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4308691617d157c7aa4b029ae95cc8d1 columnFamilyName family2 2023-11-18 20:54:04,336 INFO [StoreOpener-4308691617d157c7aa4b029ae95cc8d1-1] regionserver.HStore(310): Store=4308691617d157c7aa4b029ae95cc8d1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:04,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:54:04,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:04,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4308691617d157c7aa4b029ae95cc8d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75410293, jitterRate=0.12370093166828156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:04,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4308691617d157c7aa4b029ae95cc8d1: 2023-11-18 20:54:04,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1., pid=32, masterSystemTime=1700340844324 2023-11-18 20:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:04,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44802116890a24c27ebbbeb23abd6339, NAME => 'testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 20:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4308691617d157c7aa4b029ae95cc8d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,347 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1700340844347"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340844347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340844347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340844347"}]},"ts":"1700340844347"} 2023-11-18 20:54:04,348 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,349 DEBUG [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1 2023-11-18 20:54:04,349 DEBUG [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1 2023-11-18 20:54:04,350 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44802116890a24c27ebbbeb23abd6339 columnFamilyName family1 2023-11-18 20:54:04,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=29 2023-11-18 20:54:04,351 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] regionserver.HStore(310): Store=44802116890a24c27ebbbeb23abd6339/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 4308691617d157c7aa4b029ae95cc8d1, server=jenkins-hbase4.apache.org,32871,1700340802897 in 176 msec 2023-11-18 20:54:04,351 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4308691617d157c7aa4b029ae95cc8d1, ASSIGN in 335 msec 2023-11-18 20:54:04,353 DEBUG [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family2 2023-11-18 20:54:04,353 DEBUG [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family2 2023-11-18 20:54:04,354 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44802116890a24c27ebbbeb23abd6339 columnFamilyName family2 2023-11-18 20:54:04,354 INFO [StoreOpener-44802116890a24c27ebbbeb23abd6339-1] regionserver.HStore(310): Store=44802116890a24c27ebbbeb23abd6339/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:04,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:54:04,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:04,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44802116890a24c27ebbbeb23abd6339; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60116236, jitterRate=-0.10419827699661255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:04,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:04,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339., pid=31, masterSystemTime=1700340844324 2023-11-18 20:54:04,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:04,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88111fc5afdd533d61a509691718eaba, NAME => 'testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 20:54:04,368 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=44802116890a24c27ebbbeb23abd6339, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:04,368 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844368"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340844368"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340844368"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340844368"}]},"ts":"1700340844368"} 2023-11-18 20:54:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,369 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,371 DEBUG [StoreOpener-88111fc5afdd533d61a509691718eaba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/family1 2023-11-18 20:54:04,371 DEBUG [StoreOpener-88111fc5afdd533d61a509691718eaba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/family1 2023-11-18 20:54:04,371 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88111fc5afdd533d61a509691718eaba columnFamilyName family1 2023-11-18 20:54:04,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=30 2023-11-18 20:54:04,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 44802116890a24c27ebbbeb23abd6339, server=jenkins-hbase4.apache.org,32871,1700340802897 in 198 msec 2023-11-18 20:54:04,372 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] regionserver.HStore(310): Store=88111fc5afdd533d61a509691718eaba/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,373 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=44802116890a24c27ebbbeb23abd6339, ASSIGN in 356 msec 2023-11-18 20:54:04,374 DEBUG [StoreOpener-88111fc5afdd533d61a509691718eaba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/family2 2023-11-18 20:54:04,374 DEBUG [StoreOpener-88111fc5afdd533d61a509691718eaba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/family2 2023-11-18 20:54:04,375 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88111fc5afdd533d61a509691718eaba columnFamilyName family2 2023-11-18 20:54:04,375 INFO [StoreOpener-88111fc5afdd533d61a509691718eaba-1] regionserver.HStore(310): Store=88111fc5afdd533d61a509691718eaba/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:04,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:04,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88111fc5afdd533d61a509691718eaba 2023-11-18 20:54:04,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:04,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88111fc5afdd533d61a509691718eaba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67424656, jitterRate=0.004705667495727539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:04,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88111fc5afdd533d61a509691718eaba: 2023-11-18 20:54:04,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba., pid=33, masterSystemTime=1700340844324 2023-11-18 20:54:04,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:04,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=88111fc5afdd533d61a509691718eaba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:04,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1700340844386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340844386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340844386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340844386"}]},"ts":"1700340844386"} 2023-11-18 20:54:04,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=28 2023-11-18 20:54:04,389 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 88111fc5afdd533d61a509691718eaba, server=jenkins-hbase4.apache.org,32871,1700340802897 in 214 msec 2023-11-18 20:54:04,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-11-18 20:54:04,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=88111fc5afdd533d61a509691718eaba, ASSIGN in 373 msec 2023-11-18 20:54:04,393 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:04,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340844393"}]},"ts":"1700340844393"} 2023-11-18 20:54:04,394 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-18 20:54:04,397 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:04,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2210 sec 2023-11-18 20:54:05,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-18 20:54:05,284 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-18 20:54:05,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:05,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,294 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-18 20:54:05,294 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:05,294 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-18 20:54:05,294 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-18 20:54:05,295 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,295 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,298 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:05,298 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:05,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:05,298 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:05,298 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:05,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:05,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-18 20:54:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-18 20:54:05,299 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:05,299 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:05,299 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:54:05,300 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:05,300 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:05,300 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. started... 2023-11-18 20:54:05,299 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. started... 2023-11-18 20:54:05,300 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. started... 2023-11-18 20:54:05,301 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 88111fc5afdd533d61a509691718eaba: 2023-11-18 20:54:05,301 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 44802116890a24c27ebbbeb23abd6339 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-18 20:54:05,301 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4308691617d157c7aa4b029ae95cc8d1: 2023-11-18 20:54:05,301 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:05,301 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:05,301 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:54:05,301 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:54:05,714 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311187a892cf1c11549b0bedb6c041faa24d7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311187a892cf1c11549b0bedb6c041faa24d7 2023-11-18 20:54:06,120 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp/family1/a598b6b6ed0f42259e8106321bd400d2 2023-11-18 20:54:06,125 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp/family1/a598b6b6ed0f42259e8106321bd400d2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2 2023-11-18 20:54:06,130 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2, entries=1, sequenceid=5, filesize=4.9 K 2023-11-18 20:54:06,130 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 44802116890a24c27ebbbeb23abd6339 in 829ms, sequenceid=5, compaction requested=false 2023-11-18 20:54:06,131 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-18 20:54:06,131 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:06,131 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:06,131 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:54:06,131 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:54:06,131 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,132 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-18 20:54:06,132 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-18 20:54:06,133 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,133 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,134 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:06,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-18 20:54:06,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771c0164[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:06,135 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-18 20:54:06,135 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-18 20:54:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-18 20:54:06,137 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,137 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:06,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:06,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-18 20:54:06,139 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:06,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-18 20:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:06,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-18 20:54:06,141 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-18 20:54:06,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:06,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:06,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,141 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:06,144 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,144 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:06,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,144 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:06,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:06,145 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:06,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,146 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:06,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,148 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,148 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:06,148 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:06,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-18 20:54:06,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:06,148 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:06,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:06,148 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:06,148 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:06,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,149 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,249 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:06,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:06,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:06,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:06,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,255 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-18 20:54:06,256 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:06,256 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-18 20:54:06,256 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-18 20:54:06,256 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,256 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,257 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,257 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:06,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:06,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:06,258 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:06,258 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:06,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:06,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,259 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,259 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-18 20:54:06,259 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:06,259 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-18 20:54:06,259 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:06,259 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-18 20:54:06,259 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:06,259 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. started... 2023-11-18 20:54:06,259 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4308691617d157c7aa4b029ae95cc8d1: 2023-11-18 20:54:06,259 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:06,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:06,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. started... 2023-11-18 20:54:06,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. started... 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 88111fc5afdd533d61a509691718eaba: 2023-11-18 20:54:06,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:54:06,260 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 44802116890a24c27ebbbeb23abd6339 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-18 20:54:06,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:54:06,673 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118201341bc47fe41ffb25dd3d8e0ffead7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118201341bc47fe41ffb25dd3d8e0ffead7 2023-11-18 20:54:07,079 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp/family1/7b54fd6aaae24eae8ad777731548e0a2 2023-11-18 20:54:07,084 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp/family1/7b54fd6aaae24eae8ad777731548e0a2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2 2023-11-18 20:54:07,088 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2, entries=2, sequenceid=9, filesize=5.0 K 2023-11-18 20:54:07,089 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 44802116890a24c27ebbbeb23abd6339 in 829ms, sequenceid=9, compaction requested=false 2023-11-18 20:54:07,089 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:07,089 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:07,089 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:54:07,089 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:54:07,089 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,089 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-18 20:54:07,090 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-18 20:54:07,091 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,091 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:07,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:07,092 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:07,092 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:07,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:07,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:07,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-18 20:54:07,093 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@783d8ed[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:07,093 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-18 20:54:07,094 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,095 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-18 20:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-18 20:54:07,096 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:07,096 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,096 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:07,097 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-18 20:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:07,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:07,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-18 20:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-18 20:54:07,100 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-18 20:54:07,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:07,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:07,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,100 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:07,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:07,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:07,106 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:07,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:07,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:07,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,108 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:07,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,110 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:07,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-18 20:54:07,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-18 20:54:07,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:07,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:07,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,111 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:07,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:07,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:07,111 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,111 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,211 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:07,218 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-18 20:54:07,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 20:54:07,220 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 20:54:07,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:07,221 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341447221 2023-11-18 20:54:07,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:07,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-18 20:54:07,222 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 20:54:07,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x348b43fe to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:07,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@355fe18, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:07,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-18 20:54:08,056 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311184fc47971f46447beb7a2bcb974fd0ee9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311184fc47971f46447beb7a2bcb974fd0ee9 2023-11-18 20:54:08,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 20:54:08,070 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:08,071 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:08,078 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:08,079 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:08,089 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 first=Optional[k0] last=Optional[k1] 2023-11-18 20:54:08,089 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/6b52cdfedd8d48ebb3b049f81f95b9d6}] 2023-11-18 20:54:08,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 for inclusion in 44802116890a24c27ebbbeb23abd6339/family1 2023-11-18 20:54:08,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-18 20:54:08,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 20:54:08,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:08,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testScannerOnBulkLoadRefHFiles__jqrsie18pl8q8qc5992l3r9eod98tkfkppsfa3lvs65mftelbt8thfvi0rp4kcoa/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 2023-11-18 20:54:08,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testScannerOnBulkLoadRefHFiles__jqrsie18pl8q8qc5992l3r9eod98tkfkppsfa3lvs65mftelbt8thfvi0rp4kcoa/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_ 2023-11-18 20:54:08,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testScannerOnBulkLoadRefHFiles__jqrsie18pl8q8qc5992l3r9eod98tkfkppsfa3lvs65mftelbt8thfvi0rp4kcoa/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 into 44802116890a24c27ebbbeb23abd6339/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_ - updating store file list. 2023-11-18 20:54:08,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_ into 44802116890a24c27ebbbeb23abd6339/family1 2023-11-18 20:54:08,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testScannerOnBulkLoadRefHFiles__jqrsie18pl8q8qc5992l3r9eod98tkfkppsfa3lvs65mftelbt8thfvi0rp4kcoa/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 into 44802116890a24c27ebbbeb23abd6339/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_) 2023-11-18 20:54:08,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testScannerOnBulkLoadRefHFiles__jqrsie18pl8q8qc5992l3r9eod98tkfkppsfa3lvs65mftelbt8thfvi0rp4kcoa/family1/6b52cdfedd8d48ebb3b049f81f95b9d6 2023-11-18 20:54:08,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:54:08,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:54:08,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 44802116890a24c27ebbbeb23abd6339/family1 is initiating minor compaction (all files) 2023-11-18 20:54:08,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35c444dd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:08,106 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 44802116890a24c27ebbbeb23abd6339/family1 in testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:54:08,106 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp, totalSize=15.1 K 2023-11-18 20:54:08,106 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting a598b6b6ed0f42259e8106321bd400d2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340845284 2023-11-18 20:54:08,107 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 7b54fd6aaae24eae8ad777731548e0a2, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340845284 2023-11-18 20:54:08,108 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting a865527589724525b382836de01f37b9_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340845284 2023-11-18 20:54:08,108 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 20:54:08,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:08,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118201341bc47fe41ffb25dd3d8e0ffead7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231118201341bc47fe41ffb25dd3d8e0ffead7 2023-11-18 20:54:08,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311187a892cf1c11549b0bedb6c041faa24d7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311187a892cf1c11549b0bedb6c041faa24d7 2023-11-18 20:54:08,111 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-18 20:54:08,111 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 20:54:08,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-18 20:54:08,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-18 20:54:08,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:08,113 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-18 20:54:08,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 894 msec 2023-11-18 20:54:08,118 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 44802116890a24c27ebbbeb23abd6339#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:08,151 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=257 (was 259), OpenFileDescriptor=634 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 218), ProcessCount=172 (was 172), AvailableMemoryMB=20419 (was 20436) 2023-11-18 20:54:08,162 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=172, AvailableMemoryMB=20419 2023-11-18 20:54:08,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:54:08,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:08,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:08,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-18 20:54:08,166 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:08,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:08,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:08,168 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6 empty. 2023-11-18 20:54:08,169 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:08,169 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-18 20:54:08,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:08,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:08,576 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:08,578 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8fd816d89d9c312b32b8483945fec8e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:08,983 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:08,984 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 8fd816d89d9c312b32b8483945fec8e6, disabling compactions & flushes 2023-11-18 20:54:08,984 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:08,984 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:08,984 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. after waiting 0 ms 2023-11-18 20:54:08,984 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:08,984 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:08,984 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:08,986 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:08,987 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340848987"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340848987"}]},"ts":"1700340848987"} 2023-11-18 20:54:08,988 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:54:08,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:08,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340848989"}]},"ts":"1700340848989"} 2023-11-18 20:54:08,990 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-18 20:54:08,993 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8fd816d89d9c312b32b8483945fec8e6, ASSIGN}] 2023-11-18 20:54:08,995 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8fd816d89d9c312b32b8483945fec8e6, ASSIGN 2023-11-18 20:54:08,995 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8fd816d89d9c312b32b8483945fec8e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:09,146 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8fd816d89d9c312b32b8483945fec8e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:09,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340849146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340849146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340849146"}]},"ts":"1700340849146"} 2023-11-18 20:54:09,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 8fd816d89d9c312b32b8483945fec8e6, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:09,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:09,300 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:09,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fd816d89d9c312b32b8483945fec8e6, NAME => 'testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,304 INFO [StoreOpener-8fd816d89d9c312b32b8483945fec8e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,306 DEBUG [StoreOpener-8fd816d89d9c312b32b8483945fec8e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:09,306 DEBUG [StoreOpener-8fd816d89d9c312b32b8483945fec8e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:09,306 INFO [StoreOpener-8fd816d89d9c312b32b8483945fec8e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fd816d89d9c312b32b8483945fec8e6 columnFamilyName family1 2023-11-18 20:54:09,307 INFO [StoreOpener-8fd816d89d9c312b32b8483945fec8e6-1] regionserver.HStore(310): Store=8fd816d89d9c312b32b8483945fec8e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:09,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:54:09,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:09,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fd816d89d9c312b32b8483945fec8e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62857291, jitterRate=-0.06335337460041046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:09,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:09,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6., pid=37, masterSystemTime=1700340849300 2023-11-18 20:54:09,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:09,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:09,317 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8fd816d89d9c312b32b8483945fec8e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:09,318 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1700340849317"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340849317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340849317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340849317"}]},"ts":"1700340849317"} 2023-11-18 20:54:09,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-18 20:54:09,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 8fd816d89d9c312b32b8483945fec8e6, server=jenkins-hbase4.apache.org,32871,1700340802897 in 171 msec 2023-11-18 20:54:09,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-18 20:54:09,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8fd816d89d9c312b32b8483945fec8e6, ASSIGN in 327 msec 2023-11-18 20:54:09,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:09,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340849323"}]},"ts":"1700340849323"} 2023-11-18 20:54:09,324 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-18 20:54:09,326 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:09,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1620 sec 2023-11-18 20:54:09,340 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/.tmp/family1/b8a5fc17da19421ba67264e0be03039a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/b8a5fc17da19421ba67264e0be03039a 2023-11-18 20:54:09,347 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 44802116890a24c27ebbbeb23abd6339/family1 of 44802116890a24c27ebbbeb23abd6339 into b8a5fc17da19421ba67264e0be03039a(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:54:09,347 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:54:09,347 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1700340848106; duration=1sec 2023-11-18 20:54:09,347 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:09,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_] to archive 2023-11-18 20:54:09,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:09,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a598b6b6ed0f42259e8106321bd400d2 2023-11-18 20:54:09,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/7b54fd6aaae24eae8ad777731548e0a2 2023-11-18 20:54:09,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/family1/a865527589724525b382836de01f37b9_SeqId_12_ 2023-11-18 20:54:09,869 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:54:10,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-18 20:54:10,271 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-18 20:54:10,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:10,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,297 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:10,297 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:10,297 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:10,297 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:10,297 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,297 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,300 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:10,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:10,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:10,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:10,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:10,300 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:10,301 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:10,301 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:10,302 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:10,302 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:10,302 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:10,302 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:54:10,722 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130175fc26aa9cc457b8d4a16d1279c5d54 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130175fc26aa9cc457b8d4a16d1279c5d54 2023-11-18 20:54:11,126 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/23c44575801c4453b540d9513509713d 2023-11-18 20:54:11,131 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/23c44575801c4453b540d9513509713d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d 2023-11-18 20:54:11,136 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-18 20:54:11,137 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 835ms, sequenceid=5, compaction requested=false 2023-11-18 20:54:11,137 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:11,137 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:11,137 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:11,137 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:11,138 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,138 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:11,138 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:11,139 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:11,140 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,140 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69080263[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:11,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:11,141 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,142 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:11,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:11,143 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:11,143 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,143 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:11,145 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:11,145 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:11,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:11,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:11,147 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:11,147 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:11,147 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:11,147 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,147 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:11,151 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,151 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:11,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,151 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:11,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:11,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:11,151 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:11,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,153 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,155 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,155 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:11,155 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:11,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:54:11,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:11,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:11,156 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:11,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:11,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,157 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,257 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:11,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:11,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:11,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:11,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,263 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:11,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:11,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:11,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:11,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,265 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,265 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:11,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:11,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:11,266 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:11,266 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:11,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:11,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:11,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:11,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:11,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:11,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:11,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:11,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:11,267 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:11,267 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:11,267 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:54:11,680 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280c57cdf02e3f4ec6ae533f1dd819ab1a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511280c57cdf02e3f4ec6ae533f1dd819ab1a 2023-11-18 20:54:12,086 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/ad9ae41b50c74122b36ebe7de8aef8f9 2023-11-18 20:54:12,091 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/ad9ae41b50c74122b36ebe7de8aef8f9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9 2023-11-18 20:54:12,095 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:54:12,096 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 829ms, sequenceid=9, compaction requested=false 2023-11-18 20:54:12,096 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:12,096 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:12,096 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:12,096 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:12,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:12,097 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:12,098 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,098 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,099 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:12,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:12,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15de504d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:12,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:12,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,103 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:12,103 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,103 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:12,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:12,104 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:12,104 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:12,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:12,107 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:12,107 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:12,107 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:12,107 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,107 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:12,109 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,109 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,109 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,110 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,111 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:12,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:12,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:12,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:12,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:12,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:12,119 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:12,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:12,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:12,219 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:12,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:12,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:12,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:12,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,225 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:12,225 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:12,225 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:12,225 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:12,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,227 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,227 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:12,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:12,227 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,227 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,228 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:12,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,228 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:12,228 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:12,228 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:12,228 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:12,228 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:12,228 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:12,228 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:12,229 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:12,641 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120168efdfc661e142cebb851705d13a57b8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120168efdfc661e142cebb851705d13a57b8 2023-11-18 20:54:12,647 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/377b1bd9d62f400f9de662883d1035e2 2023-11-18 20:54:12,651 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/377b1bd9d62f400f9de662883d1035e2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2 2023-11-18 20:54:12,656 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 20:54:12,657 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 428ms, sequenceid=13, compaction requested=true 2023-11-18 20:54:12,657 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:12,657 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:12,657 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:12,658 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,658 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,659 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,659 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:12,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25e64b3[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:12,660 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:12,660 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,662 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,663 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:12,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:12,663 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:12,663 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:12,664 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:12,664 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:12,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:12,667 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:12,667 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:12,667 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:12,667 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,667 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:12,668 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,668 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:12,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,668 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:12,669 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:12,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,670 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:12,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:12,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:54:12,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:12,672 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:12,672 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:12,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:12,673 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,673 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,673 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,673 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:12,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:12,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:12,673 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:12,773 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:12,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:12,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:12,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:12,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,780 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:12,780 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:12,780 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:12,780 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:12,780 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,780 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,782 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:12,782 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:12,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:12,782 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:12,782 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:12,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:12,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,783 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:12,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:12,783 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:12,784 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:12,784 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:12,784 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:12,784 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:12,784 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:13,197 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b9100ec6cdfe43958726ffc06aee9bbb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b9100ec6cdfe43958726ffc06aee9bbb 2023-11-18 20:54:13,602 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/2c5401629e41423d8b2260fbcde7d4f0 2023-11-18 20:54:13,607 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/2c5401629e41423d8b2260fbcde7d4f0 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0 2023-11-18 20:54:13,611 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 20:54:13,612 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 828ms, sequenceid=17, compaction requested=true 2023-11-18 20:54:13,612 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:13,612 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:13,612 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:13,614 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,614 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:13,614 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,615 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:13,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:13,616 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b8380a5[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:13,616 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:13,616 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,619 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,619 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:13,619 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:13,619 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:13,619 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,619 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:13,622 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,622 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:13,622 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:13,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:13,622 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:13,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:13,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:13,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:13,624 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:13,624 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:13,624 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:13,624 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,624 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:13,632 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,632 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:13,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,632 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:13,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:13,632 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:13,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,633 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:13,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,636 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,636 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,636 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:13,636 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:13,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:13,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:13,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:54:13,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:13,636 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,637 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:13,637 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:13,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:13,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:13,737 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:13,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:13,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:13,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:13,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,743 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:13,743 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:13,743 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:13,743 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:13,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,744 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,746 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,746 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:13,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:13,746 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:13,746 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:13,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:13,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:13,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:13,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:13,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:13,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:13,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:13,747 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:13,748 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:13,748 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:13,748 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:14,160 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287cdf3e118c71455bb3a4cf10dce3a94a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287cdf3e118c71455bb3a4cf10dce3a94a 2023-11-18 20:54:14,566 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/97266e60a65a4093a830976d543b46a7 2023-11-18 20:54:14,571 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/97266e60a65a4093a830976d543b46a7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7 2023-11-18 20:54:14,575 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 20:54:14,576 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 828ms, sequenceid=21, compaction requested=true 2023-11-18 20:54:14,576 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:14,576 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:14,576 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:14,576 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:14,576 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,576 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:14,576 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:14,578 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,578 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:14,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:14,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:14,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32b182ac[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:14,580 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:14,580 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,581 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,581 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:14,581 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:14,581 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:14,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:14,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,588 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:14,588 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:14,588 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:14,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:14,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:14,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:14,590 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:14,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:14,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:14,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,590 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:14,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:14,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:14,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:14,593 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:14,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,594 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:14,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,599 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:14,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:54:14,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:14,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:14,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:14,599 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,600 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,600 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:14,600 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:14,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:14,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:14,700 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:14,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:14,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:14,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:14,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,706 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:14,706 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:14,706 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:14,706 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:14,706 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,706 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,708 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,708 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:14,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:14,708 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:14,708 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:14,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:14,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:14,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:14,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:14,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:14,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:14,709 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:14,709 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:14,709 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:14,709 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:14,805 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:54:15,122 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317c591da1bed7401fad9293be43eacfa9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512317c591da1bed7401fad9293be43eacfa9 2023-11-18 20:54:15,528 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/95655c9629714116bb0762b6c066cdef 2023-11-18 20:54:15,533 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/95655c9629714116bb0762b6c066cdef as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef 2023-11-18 20:54:15,537 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 20:54:15,538 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 829ms, sequenceid=25, compaction requested=true 2023-11-18 20:54:15,539 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:15,539 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:15,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:15,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:15,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:15,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:15,540 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,540 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:15,541 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,541 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:15,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:15,542 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550ae08f[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:15,542 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:15,542 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,545 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:15,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:15,545 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:15,545 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,545 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:15,546 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,546 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:15,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:15,546 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:15,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:15,546 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:15,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:15,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:15,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:15,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:15,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:15,549 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:15,549 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:15,549 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:15,549 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,549 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:15,551 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,551 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,551 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:15,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:15,551 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:15,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:15,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,553 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:15,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:15,555 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:15,556 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:15,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:15,556 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:15,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:15,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:15,656 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:15,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:15,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:15,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:15,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,663 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:15,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:15,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:15,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:15,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,663 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,665 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:15,665 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:15,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:15,666 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:15,666 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:15,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,666 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,667 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:15,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:15,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:15,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:15,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:15,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:15,667 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:15,667 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:15,667 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:15,667 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:16,079 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011bb5eff510cf4407a4b6b20f5a86fe62 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011bb5eff510cf4407a4b6b20f5a86fe62 2023-11-18 20:54:16,485 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/ae57c05111b14e89b106ed41b105f14a 2023-11-18 20:54:16,490 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/ae57c05111b14e89b106ed41b105f14a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a 2023-11-18 20:54:16,494 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 20:54:16,495 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 828ms, sequenceid=29, compaction requested=true 2023-11-18 20:54:16,495 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:16,495 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:16,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:16,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:16,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:16,496 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:16,498 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,498 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:16,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:16,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:16,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24007d61[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:16,500 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:16,500 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,501 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:16,501 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:16,501 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,501 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:16,503 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,503 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:16,503 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:16,503 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:16,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:16,505 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:16,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:16,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:16,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,505 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:16,508 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,508 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:16,508 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:16,508 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,509 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:16,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:16,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:16,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:16,512 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:16,512 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:16,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:16,513 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,513 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,513 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,513 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:16,513 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:16,613 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:16,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:16,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:16,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:16,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,620 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:16,620 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:16,620 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:16,620 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:16,620 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,620 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,621 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:16,621 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:16,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:16,622 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:16,622 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:16,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:16,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:16,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:16,623 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:16,623 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:16,623 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:16,623 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:16,623 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:16,623 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:16,623 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:16,623 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:17,036 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103127f0c8367ef4f1a8e35dd7ccc9c4884 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103127f0c8367ef4f1a8e35dd7ccc9c4884 2023-11-18 20:54:17,442 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/5ef0c3bcbe204a7eba3bb4eb88af3288 2023-11-18 20:54:17,447 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/5ef0c3bcbe204a7eba3bb4eb88af3288 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288 2023-11-18 20:54:17,452 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 20:54:17,452 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 829ms, sequenceid=33, compaction requested=true 2023-11-18 20:54:17,452 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:17,453 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:17,453 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:17,454 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,454 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,455 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:17,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:17,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@238147ec[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:17,456 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:17,456 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,461 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,461 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:17,461 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:17,462 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:17,462 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,462 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:17,463 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:17,463 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,463 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:17,463 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:17,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:17,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:17,465 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:17,465 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:17,465 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:17,465 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:17,465 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,465 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:17,467 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,467 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:17,467 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:17,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:17,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:17,467 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:17,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,469 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,471 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:17,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:17,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:17,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:17,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:17,472 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:17,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:17,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:17,572 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:17,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:17,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,578 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:17,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:17,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:17,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:17,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,578 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,581 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:17,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:17,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:17,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:17,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:17,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:17,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:17,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:17,583 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:17,583 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:17,583 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:17,583 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:17,995 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090779caae35bc964054817a33ff84348149 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090779caae35bc964054817a33ff84348149 2023-11-18 20:54:18,401 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/d4577cbb8f484219b59d39cbb718bad4 2023-11-18 20:54:18,406 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/d4577cbb8f484219b59d39cbb718bad4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4 2023-11-18 20:54:18,410 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 20:54:18,411 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 828ms, sequenceid=37, compaction requested=true 2023-11-18 20:54:18,411 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:18,411 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:18,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:18,413 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:18,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:18,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:18,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d9b15d2[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:18,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,416 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,416 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:18,416 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:18,416 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:18,416 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,416 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:18,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,417 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:18,418 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:18,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:18,420 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:18,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:18,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:18,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,420 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:18,423 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,423 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,423 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:18,424 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,425 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,427 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,428 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:18,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:18,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:18,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:18,428 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:18,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:18,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:18,528 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:18,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:18,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:18,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,535 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:18,535 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:18,535 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-18 20:54:18,535 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-18 20:54:18,536 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,536 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,537 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,537 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:18,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:18,537 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,537 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,538 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,538 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-18 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-18 20:54:18,538 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:18,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-18 20:54:18,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:18,539 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:18,539 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:18,539 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. started... 2023-11-18 20:54:18,539 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8fd816d89d9c312b32b8483945fec8e6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:18,952 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120351b97edf4ff4ac5be9fa609cdf15935 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120351b97edf4ff4ac5be9fa609cdf15935 2023-11-18 20:54:18,971 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/c5f3835490bc48c19b6fddf5167e372e 2023-11-18 20:54:18,976 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/c5f3835490bc48c19b6fddf5167e372e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e 2023-11-18 20:54:18,980 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 20:54:18,981 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8fd816d89d9c312b32b8483945fec8e6 in 442ms, sequenceid=41, compaction requested=true 2023-11-18 20:54:18,981 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:18,981 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-18 20:54:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-18 20:54:18,983 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,983 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,983 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,983 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-18 20:54:18,985 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-18 20:54:18,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f178076[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:18,985 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,986 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-18 20:54:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-18 20:54:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:18,986 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,986 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-18 20:54:18,988 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-18 20:54:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:18,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:54:18,990 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-18 20:54:18,990 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:18,990 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:18,990 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,990 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:18,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:18,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:18,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:18,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,993 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:18,994 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:18,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-18 20:54:18,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:18,997 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:18,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:18,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:18,998 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,998 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:18,998 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:18,998 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:18,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:18,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:19,098 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:19,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:19,100 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-18 20:54:19,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:19,103 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:19,104 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:19,104 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341459104 2023-11-18 20:54:19,106 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:19,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-18 20:54:19,107 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:19,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x50f0baab to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:19,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2d034b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:19,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:19,953 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103189ee3dea02d4bfb967ca0613602d73b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103189ee3dea02d4bfb967ca0613602d73b 2023-11-18 20:54:19,954 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:19,969 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:19,970 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:19,976 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:19,977 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:19,985 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c7ac79f21b749bfa71ab9855734a6b7 first=Optional[r3] last=Optional[r6] 2023-11-18 20:54:19,985 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c7ac79f21b749bfa71ab9855734a6b7}] 2023-11-18 20:54:19,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c7ac79f21b749bfa71ab9855734a6b7 for inclusion in 8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:19,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 20:54:19,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:19,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:19,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/7c7ac79f21b749bfa71ab9855734a6b7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j0davlepisncq0ole7k88i4eql6rm0vvrdldbjuvutmbp6daj92ada1ubblng57/family1/7c7ac79f21b749bfa71ab9855734a6b7 2023-11-18 20:54:19,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j0davlepisncq0ole7k88i4eql6rm0vvrdldbjuvutmbp6daj92ada1ubblng57/family1/7c7ac79f21b749bfa71ab9855734a6b7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_ 2023-11-18 20:54:19,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j0davlepisncq0ole7k88i4eql6rm0vvrdldbjuvutmbp6daj92ada1ubblng57/family1/7c7ac79f21b749bfa71ab9855734a6b7 into 8fd816d89d9c312b32b8483945fec8e6/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_ - updating store file list. 2023-11-18 20:54:19,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_ into 8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:19,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j0davlepisncq0ole7k88i4eql6rm0vvrdldbjuvutmbp6daj92ada1ubblng57/family1/7c7ac79f21b749bfa71ab9855734a6b7 into 8fd816d89d9c312b32b8483945fec8e6/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_) 2023-11-18 20:54:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__5j0davlepisncq0ole7k88i4eql6rm0vvrdldbjuvutmbp6daj92ada1ubblng57/family1/7c7ac79f21b749bfa71ab9855734a6b7 2023-11-18 20:54:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:54:20,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:54:20,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 8fd816d89d9c312b32b8483945fec8e6/family1 is initiating minor compaction 2023-11-18 20:54:20,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4c8b3dc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:20,003 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8fd816d89d9c312b32b8483945fec8e6/family1 in testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:20,003 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp, totalSize=50.0 K 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ad9ae41b50c74122b36ebe7de8aef8f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 377b1bd9d62f400f9de662883d1035e2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 2c5401629e41423d8b2260fbcde7d4f0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 97266e60a65a4093a830976d543b46a7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 95655c9629714116bb0762b6c066cdef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting ae57c05111b14e89b106ed41b105f14a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 5ef0c3bcbe204a7eba3bb4eb88af3288, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:54:20,003 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting d4577cbb8f484219b59d39cbb718bad4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:54:20,004 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting c5f3835490bc48c19b6fddf5167e372e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:54:20,004 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:54:20,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:20,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:20,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287cdf3e118c71455bb3a4cf10dce3a94a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512287cdf3e118c71455bb3a4cf10dce3a94a 2023-11-18 20:54:20,008 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512317c591da1bed7401fad9293be43eacfa9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512317c591da1bed7401fad9293be43eacfa9 2023-11-18 20:54:20,010 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011bb5eff510cf4407a4b6b20f5a86fe62 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011bb5eff510cf4407a4b6b20f5a86fe62 2023-11-18 20:54:20,011 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103127f0c8367ef4f1a8e35dd7ccc9c4884 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103127f0c8367ef4f1a8e35dd7ccc9c4884 2023-11-18 20:54:20,011 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-18 20:54:20,011 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,012 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,054 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:20,054 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x348b43fe to 127.0.0.1:55479 2023-11-18 20:54:20,054 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:20,054 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:20,055 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c20758e to 127.0.0.1:55479 2023-11-18 20:54:20,055 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:20,055 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:20,055 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ba65eb8 to 127.0.0.1:55479 2023-11-18 20:54:20,055 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:20,060 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8fd816d89d9c312b32b8483945fec8e6#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:20,489 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/4912979d9e6d473eac492cd8877bfeb2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/4912979d9e6d473eac492cd8877bfeb2 2023-11-18 20:54:20,494 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8fd816d89d9c312b32b8483945fec8e6/family1 of 8fd816d89d9c312b32b8483945fec8e6 into 4912979d9e6d473eac492cd8877bfeb2(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:20,494 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:20,495 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1700340860003; duration=0sec 2023-11-18 20:54:20,495 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:20,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_] to archive 2023-11-18 20:54:20,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:20,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ad9ae41b50c74122b36ebe7de8aef8f9 2023-11-18 20:54:20,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/377b1bd9d62f400f9de662883d1035e2 2023-11-18 20:54:20,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/2c5401629e41423d8b2260fbcde7d4f0 2023-11-18 20:54:20,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/97266e60a65a4093a830976d543b46a7 2023-11-18 20:54:20,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/95655c9629714116bb0762b6c066cdef 2023-11-18 20:54:20,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/ae57c05111b14e89b106ed41b105f14a 2023-11-18 20:54:20,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/5ef0c3bcbe204a7eba3bb4eb88af3288 2023-11-18 20:54:20,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/d4577cbb8f484219b59d39cbb718bad4 2023-11-18 20:54:20,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/c5f3835490bc48c19b6fddf5167e372e 2023-11-18 20:54:20,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/cb1df524e4914a35b9e93ba5c3d5c375_SeqId_44_ 2023-11-18 20:54:20,893 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050d7a05e49d924ca68b87bd0700f1c53d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050d7a05e49d924ca68b87bd0700f1c53d 2023-11-18 20:54:20,894 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:20,917 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a322b04fa35c46dc85358d7dcabb26bc first=Optional[r00] last=Optional[r2] 2023-11-18 20:54:20,918 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a322b04fa35c46dc85358d7dcabb26bc}] 2023-11-18 20:54:20,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a322b04fa35c46dc85358d7dcabb26bc for inclusion in 8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 20:54:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:20,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:20,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a322b04fa35c46dc85358d7dcabb26bc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6skjnebi5pvpkfd4bt1u50fhoc305rf2g6u9il8i7cjfsbm4u9kjghvefsvq5gf1/family1/a322b04fa35c46dc85358d7dcabb26bc 2023-11-18 20:54:20,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6skjnebi5pvpkfd4bt1u50fhoc305rf2g6u9il8i7cjfsbm4u9kjghvefsvq5gf1/family1/a322b04fa35c46dc85358d7dcabb26bc as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_ 2023-11-18 20:54:20,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6skjnebi5pvpkfd4bt1u50fhoc305rf2g6u9il8i7cjfsbm4u9kjghvefsvq5gf1/family1/a322b04fa35c46dc85358d7dcabb26bc into 8fd816d89d9c312b32b8483945fec8e6/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_ - updating store file list. 2023-11-18 20:54:20,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_ into 8fd816d89d9c312b32b8483945fec8e6/family1 2023-11-18 20:54:20,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6skjnebi5pvpkfd4bt1u50fhoc305rf2g6u9il8i7cjfsbm4u9kjghvefsvq5gf1/family1/a322b04fa35c46dc85358d7dcabb26bc into 8fd816d89d9c312b32b8483945fec8e6/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_) 2023-11-18 20:54:20,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__6skjnebi5pvpkfd4bt1u50fhoc305rf2g6u9il8i7cjfsbm4u9kjghvefsvq5gf1/family1/a322b04fa35c46dc85358d7dcabb26bc 2023-11-18 20:54:20,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:54:20,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:54:20,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 8fd816d89d9c312b32b8483945fec8e6/family1 is initiating minor compaction (all files) 2023-11-18 20:54:20,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@464e6c68; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:20,932 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8fd816d89d9c312b32b8483945fec8e6/family1 in testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:54:20,933 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/4912979d9e6d473eac492cd8877bfeb2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp, totalSize=337.0 K 2023-11-18 20:54:20,933 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 23c44575801c4453b540d9513509713d, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:54:20,934 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 4912979d9e6d473eac492cd8877bfeb2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:54:20,934 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting e6305c028ff046a39ff76bc0a5db061e_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826804 2023-11-18 20:54:20,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:20,935 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:20,936 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130175fc26aa9cc457b8d4a16d1279c5d54 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130175fc26aa9cc457b8d4a16d1279c5d54 2023-11-18 20:54:20,937 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120168efdfc661e142cebb851705d13a57b8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120168efdfc661e142cebb851705d13a57b8 2023-11-18 20:54:20,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b9100ec6cdfe43958726ffc06aee9bbb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b9100ec6cdfe43958726ffc06aee9bbb 2023-11-18 20:54:20,939 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-18 20:54:20,939 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 20:54:20,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-18 20:54:20,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-18 20:54:20,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:20,940 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:54:20,942 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8390 sec 2023-11-18 20:54:20,954 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8fd816d89d9c312b32b8483945fec8e6#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:21,035 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=257 (was 257), OpenFileDescriptor=637 (was 634) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=169 (was 200), ProcessCount=172 (was 172), AvailableMemoryMB=20358 (was 20419) 2023-11-18 20:54:21,046 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=257, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=169, ProcessCount=172, AvailableMemoryMB=20357 2023-11-18 20:54:21,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:54:21,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:21,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:21,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-18 20:54:21,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:21,051 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:21,053 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:21,053 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 empty. 2023-11-18 20:54:21,054 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:21,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-18 20:54:21,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:21,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:21,461 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:21,463 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0818667696a0f9030b3b6acc9f576231, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:21,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 0818667696a0f9030b3b6acc9f576231, disabling compactions & flushes 2023-11-18 20:54:21,868 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. after waiting 0 ms 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:21,868 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:21,868 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:21,871 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:21,872 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340861872"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340861872"}]},"ts":"1700340861872"} 2023-11-18 20:54:21,874 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:54:21,875 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:21,875 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340861875"}]},"ts":"1700340861875"} 2023-11-18 20:54:21,876 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-18 20:54:21,879 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, ASSIGN}] 2023-11-18 20:54:21,880 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, ASSIGN 2023-11-18 20:54:21,881 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:22,032 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:22,032 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340862032"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340862032"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340862032"}]},"ts":"1700340862032"} 2023-11-18 20:54:22,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:22,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:22,175 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/.tmp/family1/e032326c63aa49d3b7d87f7622892e2c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e032326c63aa49d3b7d87f7622892e2c 2023-11-18 20:54:22,180 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8fd816d89d9c312b32b8483945fec8e6/family1 of 8fd816d89d9c312b32b8483945fec8e6 into e032326c63aa49d3b7d87f7622892e2c(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:54:22,180 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:54:22,181 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1700340860932; duration=1sec 2023-11-18 20:54:22,181 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:22,185 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:22,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:22,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0818667696a0f9030b3b6acc9f576231, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:22,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:22,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,189 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,191 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:22,191 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:22,191 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0818667696a0f9030b3b6acc9f576231 columnFamilyName family1 2023-11-18 20:54:22,192 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(310): Store=0818667696a0f9030b3b6acc9f576231/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:22,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:22,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:22,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0818667696a0f9030b3b6acc9f576231; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63967062, jitterRate=-0.046816498041152954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:22,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:22,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., pid=41, masterSystemTime=1700340862185 2023-11-18 20:54:22,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:22,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:22,201 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:22,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340862201"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340862201"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340862201"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340862201"}]},"ts":"1700340862201"} 2023-11-18 20:54:22,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-18 20:54:22,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897 in 168 msec 2023-11-18 20:54:22,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-18 20:54:22,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, ASSIGN in 325 msec 2023-11-18 20:54:22,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:22,206 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340862206"}]},"ts":"1700340862206"} 2023-11-18 20:54:22,207 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-18 20:54:22,210 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:22,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1620 sec 2023-11-18 20:54:22,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/4912979d9e6d473eac492cd8877bfeb2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_] to archive 2023-11-18 20:54:22,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:22,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/23c44575801c4453b540d9513509713d 2023-11-18 20:54:22,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/4912979d9e6d473eac492cd8877bfeb2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/4912979d9e6d473eac492cd8877bfeb2 2023-11-18 20:54:22,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/family1/e6305c028ff046a39ff76bc0a5db061e_SeqId_47_ 2023-11-18 20:54:23,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-18 20:54:23,156 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-18 20:54:23,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:23,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,176 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:23,176 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:23,176 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:23,176 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:23,177 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,177 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,178 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:23,178 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:23,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:23,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:23,179 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:23,179 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:23,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:23,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,179 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,180 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:23,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:23,180 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:23,180 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:23,181 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:54:23,600 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130487e34929b8f40d39fa94fd4c374aead to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130487e34929b8f40d39fa94fd4c374aead 2023-11-18 20:54:24,004 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/4c536595bafb44a0964f2b40c8d08df3 2023-11-18 20:54:24,008 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/4c536595bafb44a0964f2b40c8d08df3 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3 2023-11-18 20:54:24,012 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-18 20:54:24,013 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 832ms, sequenceid=5, compaction requested=false 2023-11-18 20:54:24,013 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:24,013 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:24,013 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:24,014 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:24,015 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,015 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,016 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,016 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:24,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385b0d80[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:24,017 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:24,017 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,018 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:24,018 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:24,018 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,018 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:24,021 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:24,021 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:24,023 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:24,023 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:24,023 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:24,023 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:24,023 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,023 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:24,025 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,025 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:24,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,025 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:24,025 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,027 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:24,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:24,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:24,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:24,029 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:24,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,029 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,130 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:24,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:24,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:24,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:24,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,136 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:24,136 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:24,136 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:24,136 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:24,136 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,136 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,137 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:24,137 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,138 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,138 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:24,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,139 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:24,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:24,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:24,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:24,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:24,139 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:24,139 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:24,139 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:24,139 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:54:24,552 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285bef2e3e2ef34047be92c705a5f97e9c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bef2e3e2ef34047be92c705a5f97e9c 2023-11-18 20:54:24,958 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/0d5a461eaf2f459783e11db8e95cdd7b 2023-11-18 20:54:24,963 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/0d5a461eaf2f459783e11db8e95cdd7b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b 2023-11-18 20:54:24,968 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:54:24,968 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 829ms, sequenceid=9, compaction requested=false 2023-11-18 20:54:24,969 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:24,969 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:24,969 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:24,969 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:24,969 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,969 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:24,969 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:24,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:24,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:24,973 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114c9340[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:24,973 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:24,973 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,974 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:24,974 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:24,974 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,974 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:24,976 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:24,976 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,976 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,976 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:24,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:24,979 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:24,979 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:24,979 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:24,979 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,979 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:24,981 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,981 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:24,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,981 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:24,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:24,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:24,982 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,983 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:24,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:24,992 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:24,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:24,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,992 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:24,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:24,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:24,993 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:24,993 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:25,093 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:25,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:25,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,099 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:25,099 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:25,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:25,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:25,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,100 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,101 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,101 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:25,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:25,101 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,102 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,103 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:25,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:25,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:25,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:25,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:25,103 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:25,103 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:25,103 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:25,103 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:25,516 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018c725a6d22fd416cb94c0f1f6023bf6c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018c725a6d22fd416cb94c0f1f6023bf6c 2023-11-18 20:54:25,922 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/f9862561874c4899b8487bab4555b7bd 2023-11-18 20:54:25,926 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/f9862561874c4899b8487bab4555b7bd as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd 2023-11-18 20:54:25,930 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 20:54:25,931 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 828ms, sequenceid=13, compaction requested=true 2023-11-18 20:54:25,931 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:25,931 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,932 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:25,932 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,933 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:25,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,933 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:25,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:25,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54bc313e[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:25,935 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:25,935 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,936 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:25,936 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:25,936 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,936 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:25,937 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,937 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:25,937 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:25,938 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:25,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:25,940 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:25,940 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:25,940 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:25,940 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,940 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:25,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:25,945 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:25,945 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,946 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,948 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:25,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:25,949 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:25,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:25,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:25,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:25,949 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:26,049 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:26,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:26,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:26,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:26,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,056 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:26,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:26,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:26,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:26,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,057 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:26,057 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:26,058 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,058 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:26,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,059 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,059 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:26,059 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:26,059 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:26,059 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:26,059 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:26,059 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:26,472 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051c46a4e8cda94b9996bc8ec8650c7fc5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512051c46a4e8cda94b9996bc8ec8650c7fc5 2023-11-18 20:54:26,878 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/4632959bfd7a46fa8fbd3ac4a2b47884 2023-11-18 20:54:26,883 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/4632959bfd7a46fa8fbd3ac4a2b47884 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884 2023-11-18 20:54:26,887 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 20:54:26,888 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 829ms, sequenceid=17, compaction requested=true 2023-11-18 20:54:26,888 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:26,888 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,888 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:26,889 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:26,890 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,890 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:26,891 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,891 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:26,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@778b1fef[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:26,892 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:26,893 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,897 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,897 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:26,897 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:26,897 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,897 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:26,897 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:26,899 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:26,899 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:26,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:26,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:26,902 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:26,902 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:26,902 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:26,902 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,902 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:26,904 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,904 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,904 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:26,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:26,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:26,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,905 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,908 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:26,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:26,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:26,908 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:26,909 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:26,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:27,009 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:27,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:27,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:27,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:27,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,015 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:27,015 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:27,015 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:27,015 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:27,015 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,015 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,021 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:27,021 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:27,021 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,021 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:27,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,022 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:27,022 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:27,022 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:27,023 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:27,023 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:27,023 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:27,023 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:27,435 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a80945e5a5cc45d0a30c5dcac50c68e8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a80945e5a5cc45d0a30c5dcac50c68e8 2023-11-18 20:54:27,440 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/f6a14b60c47c4efe8d6f1ea5f31d124f 2023-11-18 20:54:27,444 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/f6a14b60c47c4efe8d6f1ea5f31d124f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f 2023-11-18 20:54:27,448 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 20:54:27,449 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 426ms, sequenceid=21, compaction requested=true 2023-11-18 20:54:27,449 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:27,449 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:27,449 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:27,449 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:27,449 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,450 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:27,450 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:27,451 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:27,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:27,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,451 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:27,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:27,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:27,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:27,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:27,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@175c2b93[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:27,453 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:27,453 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,454 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,454 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:27,454 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:27,454 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:27,454 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,454 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:27,455 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:27,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:27,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:27,455 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:27,456 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:27,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:27,458 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:27,458 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:27,458 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:27,458 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:27,458 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,458 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:27,460 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,460 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:27,460 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:27,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:27,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:27,461 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:27,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,462 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:27,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,464 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:27,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:27,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:27,465 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:27,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:27,465 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,565 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:27,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:27,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:27,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:27,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,571 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:27,571 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:27,571 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:27,571 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:27,571 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,572 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,573 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,573 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:27,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:27,573 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:27,573 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:27,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:27,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,574 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:27,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:27,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:27,574 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:27,574 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:27,574 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:27,717 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:54:27,987 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fbc1ec60030e4159b55798eea1e21a53 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fbc1ec60030e4159b55798eea1e21a53 2023-11-18 20:54:28,392 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/a2a109fd12d04b7886bb333dedb5a5db 2023-11-18 20:54:28,397 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/a2a109fd12d04b7886bb333dedb5a5db as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db 2023-11-18 20:54:28,402 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 20:54:28,402 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 828ms, sequenceid=25, compaction requested=true 2023-11-18 20:54:28,402 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:28,402 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:28,403 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:28,405 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,405 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:28,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:28,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627f7cab[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:28,406 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:28,407 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,407 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:28,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:28,408 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,408 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:28,408 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:28,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:28,409 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:28,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:28,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:28,411 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:28,411 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:28,411 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:28,411 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,411 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:28,413 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,413 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:28,413 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:28,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:28,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:28,413 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:28,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:28,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:28,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:28,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:28,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:28,418 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:28,417 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:28,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,418 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,518 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:28,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:28,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:28,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:28,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,524 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:28,524 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:28,524 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:28,524 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:28,525 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,525 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,526 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:28,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:28,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:28,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:28,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:28,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,527 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,527 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:28,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:28,527 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:28,527 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:28,527 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:28,527 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:28,527 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:28,527 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:28,527 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:28,528 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:28,939 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b896e171488e462c801cd37d072f3f39 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101b896e171488e462c801cd37d072f3f39 2023-11-18 20:54:29,344 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/28eeb031eaa54142bb710a44865df1ba 2023-11-18 20:54:29,349 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/28eeb031eaa54142bb710a44865df1ba as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba 2023-11-18 20:54:29,354 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 20:54:29,355 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 827ms, sequenceid=29, compaction requested=true 2023-11-18 20:54:29,355 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:29,355 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:29,355 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:29,355 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:29,355 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,355 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:29,355 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:29,356 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:29,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:29,357 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,357 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:29,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:29,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57ff841b[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:29,358 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:29,358 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,359 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:29,359 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:29,359 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,359 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:29,364 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,364 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:29,364 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:29,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:29,364 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:29,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:29,366 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:29,367 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:29,367 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:29,367 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,367 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:29,368 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,368 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:29,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,368 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:29,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:29,369 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,370 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:29,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:29,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,372 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:29,372 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:29,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:29,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:29,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:29,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:29,472 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:29,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:29,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:29,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,478 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:29,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:29,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:29,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:29,479 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,479 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:29,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:29,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:29,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:29,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:29,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:29,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:29,482 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:29,482 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:29,482 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:29,482 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:29,893 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033e55e448761e43ec9ee62a52bdaa5361 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e55e448761e43ec9ee62a52bdaa5361 2023-11-18 20:54:30,299 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/bf7a35176fe545809ae6df833ebb47f5 2023-11-18 20:54:30,304 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/bf7a35176fe545809ae6df833ebb47f5 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5 2023-11-18 20:54:30,307 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 20:54:30,308 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 826ms, sequenceid=33, compaction requested=true 2023-11-18 20:54:30,308 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:30,308 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:30,308 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:30,308 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:30,308 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:30,309 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:30,311 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:30,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:30,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:30,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78a48d6c[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:30,312 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:30,313 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,313 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:30,314 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,314 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:30,314 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:30,315 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:30,315 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,315 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:30,315 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:30,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:30,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:30,317 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:30,317 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:30,317 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:30,317 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,317 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:30,319 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,319 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,319 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:30,319 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:30,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:30,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:30,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:30,324 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-18 20:54:30,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:30,324 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:30,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:30,324 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:30,324 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:30,324 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,324 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,424 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:30,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:30,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:30,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,430 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:30,430 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:30,431 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,431 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,432 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:30,432 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:30,432 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:30,432 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:30,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:30,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,433 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:30,433 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:30,433 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:30,434 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:30,434 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:30,434 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:30,434 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:30,434 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:30,846 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907433630cff52c4540a934040ba6e67d6c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907433630cff52c4540a934040ba6e67d6c 2023-11-18 20:54:31,251 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/b88290cd734041b19ad620acc86f8dff 2023-11-18 20:54:31,256 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/b88290cd734041b19ad620acc86f8dff as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff 2023-11-18 20:54:31,259 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 20:54:31,260 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 826ms, sequenceid=37, compaction requested=true 2023-11-18 20:54:31,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:31,260 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:31,260 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:31,262 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,262 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:31,263 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,263 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:31,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ed22158[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:31,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:31,264 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,265 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:31,265 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:31,266 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,266 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:31,267 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,267 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:31,268 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:31,268 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:31,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:31,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:31,270 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:31,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:31,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:31,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,270 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:31,271 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,271 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:31,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,271 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:31,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:31,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,273 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,278 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:31,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:31,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:31,279 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:31,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,379 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:31,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:31,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:31,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:31,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,385 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:31,385 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:31,385 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-18 20:54:31,385 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-18 20:54:31,386 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,386 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,388 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,388 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:31,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:31,388 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:31,388 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:31,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:31,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-18 20:54:31,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-18 20:54:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-18 20:54:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:31,389 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:31,389 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:31,390 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. started... 2023-11-18 20:54:31,390 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0818667696a0f9030b3b6acc9f576231 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:31,801 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fb253de3459742b5adf3670961e6303d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb253de3459742b5adf3670961e6303d 2023-11-18 20:54:32,207 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/1ddc66026c52485298f643218161302e 2023-11-18 20:54:32,212 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/1ddc66026c52485298f643218161302e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e 2023-11-18 20:54:32,215 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 20:54:32,216 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0818667696a0f9030b3b6acc9f576231 in 826ms, sequenceid=41, compaction requested=true 2023-11-18 20:54:32,216 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:32,216 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:32,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-18 20:54:32,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-18 20:54:32,218 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,218 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:32,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:32,219 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,219 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-18 20:54:32,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17d18e0d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:32,220 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-18 20:54:32,220 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,221 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,221 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-18 20:54:32,222 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-18 20:54:32,222 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:32,222 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,222 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:32,223 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-18 20:54:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:32,223 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-18 20:54:32,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:32,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:32,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-18 20:54:32,225 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-18 20:54:32,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:32,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:32,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,226 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:32,228 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,228 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,228 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:32,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:32,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:32,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,230 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:32,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:32,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:32,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:32,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:32,233 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:32,334 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:32,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:32,335 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:32,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:32,338 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:32,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:32,338 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341472338 2023-11-18 20:54:32,341 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:32,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 20:54:32,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:32,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x0262aca6 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:32,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60acba52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:32,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,786 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a50328db74304ffa970b1000cb840c09 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103a50328db74304ffa970b1000cb840c09 2023-11-18 20:54:32,787 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:32,799 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:32,800 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:32,806 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:32,807 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:32,815 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4110a39562f4db8a2e2110ae2433d6c first=Optional[r3] last=Optional[r6] 2023-11-18 20:54:32,815 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4110a39562f4db8a2e2110ae2433d6c}] 2023-11-18 20:54:32,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4110a39562f4db8a2e2110ae2433d6c for inclusion in 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:32,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 20:54:32,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:32,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:32,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e4110a39562f4db8a2e2110ae2433d6c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__d5b7hui7hrl2hvbbdleonkasp8t2he99ev2gg95cfjr32amid3sv2da1uhlvqvni/family1/e4110a39562f4db8a2e2110ae2433d6c 2023-11-18 20:54:32,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__d5b7hui7hrl2hvbbdleonkasp8t2he99ev2gg95cfjr32amid3sv2da1uhlvqvni/family1/e4110a39562f4db8a2e2110ae2433d6c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_ 2023-11-18 20:54:32,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__d5b7hui7hrl2hvbbdleonkasp8t2he99ev2gg95cfjr32amid3sv2da1uhlvqvni/family1/e4110a39562f4db8a2e2110ae2433d6c into 0818667696a0f9030b3b6acc9f576231/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_ - updating store file list. 2023-11-18 20:54:32,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_ into 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:32,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__d5b7hui7hrl2hvbbdleonkasp8t2he99ev2gg95cfjr32amid3sv2da1uhlvqvni/family1/e4110a39562f4db8a2e2110ae2433d6c into 0818667696a0f9030b3b6acc9f576231/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_) 2023-11-18 20:54:32,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__d5b7hui7hrl2hvbbdleonkasp8t2he99ev2gg95cfjr32amid3sv2da1uhlvqvni/family1/e4110a39562f4db8a2e2110ae2433d6c 2023-11-18 20:54:32,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:54:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:54:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 0818667696a0f9030b3b6acc9f576231/family1 is initiating minor compaction 2023-11-18 20:54:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@23601632; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:32,831 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0818667696a0f9030b3b6acc9f576231/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:32,832 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp, totalSize=50.4 K 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 0d5a461eaf2f459783e11db8e95cdd7b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f9862561874c4899b8487bab4555b7bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 4632959bfd7a46fa8fbd3ac4a2b47884, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f6a14b60c47c4efe8d6f1ea5f31d124f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting a2a109fd12d04b7886bb333dedb5a5db, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 28eeb031eaa54142bb710a44865df1ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting bf7a35176fe545809ae6df833ebb47f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting b88290cd734041b19ad620acc86f8dff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 1ddc66026c52485298f643218161302e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:54:32,832 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f576d7f0708f4fefa9b2e711884cf077_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:54:32,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:32,834 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:32,835 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a80945e5a5cc45d0a30c5dcac50c68e8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a80945e5a5cc45d0a30c5dcac50c68e8 2023-11-18 20:54:32,837 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fbc1ec60030e4159b55798eea1e21a53 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231fbc1ec60030e4159b55798eea1e21a53 2023-11-18 20:54:32,838 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101b896e171488e462c801cd37d072f3f39 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101b896e171488e462c801cd37d072f3f39 2023-11-18 20:54:32,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e55e448761e43ec9ee62a52bdaa5361 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601033e55e448761e43ec9ee62a52bdaa5361 2023-11-18 20:54:32,839 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-18 20:54:32,839 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,840 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:32,856 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0818667696a0f9030b3b6acc9f576231#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:33,672 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/b876bc737f07453ea84d69a7d3f07086 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b876bc737f07453ea84d69a7d3f07086 2023-11-18 20:54:33,677 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0818667696a0f9030b3b6acc9f576231/family1 of 0818667696a0f9030b3b6acc9f576231 into b876bc737f07453ea84d69a7d3f07086(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:33,677 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:33,677 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700340872831; duration=0sec 2023-11-18 20:54:33,677 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:33,684 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205392c1b07f8764d3c8f66a4733b49b557 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205392c1b07f8764d3c8f66a4733b49b557 2023-11-18 20:54:33,684 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:33,707 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/404cec7c17944fbb904dcd01d980a29e first=Optional[r00] last=Optional[r2] 2023-11-18 20:54:33,708 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/404cec7c17944fbb904dcd01d980a29e}] 2023-11-18 20:54:33,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/404cec7c17944fbb904dcd01d980a29e for inclusion in 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 20:54:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:33,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:33,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/404cec7c17944fbb904dcd01d980a29e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uod7ge3301m9sq1bsh4co9qbquj3og7pafvi6a8pv8mkpn02dhuol8qmmd6i13v5/family1/404cec7c17944fbb904dcd01d980a29e 2023-11-18 20:54:33,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uod7ge3301m9sq1bsh4co9qbquj3og7pafvi6a8pv8mkpn02dhuol8qmmd6i13v5/family1/404cec7c17944fbb904dcd01d980a29e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_ 2023-11-18 20:54:33,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uod7ge3301m9sq1bsh4co9qbquj3og7pafvi6a8pv8mkpn02dhuol8qmmd6i13v5/family1/404cec7c17944fbb904dcd01d980a29e into 0818667696a0f9030b3b6acc9f576231/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_ - updating store file list. 2023-11-18 20:54:33,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_ into 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:33,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uod7ge3301m9sq1bsh4co9qbquj3og7pafvi6a8pv8mkpn02dhuol8qmmd6i13v5/family1/404cec7c17944fbb904dcd01d980a29e into 0818667696a0f9030b3b6acc9f576231/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_) 2023-11-18 20:54:33,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__uod7ge3301m9sq1bsh4co9qbquj3og7pafvi6a8pv8mkpn02dhuol8qmmd6i13v5/family1/404cec7c17944fbb904dcd01d980a29e 2023-11-18 20:54:33,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:54:33,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:54:33,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 0818667696a0f9030b3b6acc9f576231/family1 is initiating minor compaction (all files) 2023-11-18 20:54:33,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@8e938aa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:33,722 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0818667696a0f9030b3b6acc9f576231/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:33,723 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b876bc737f07453ea84d69a7d3f07086, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp, totalSize=390.1 K 2023-11-18 20:54:33,723 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 4c536595bafb44a0964f2b40c8d08df3, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:54:33,723 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting b876bc737f07453ea84d69a7d3f07086, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:54:33,724 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 2197db13097f4818a247502feabde767_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826804 2023-11-18 20:54:33,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:33,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:33,727 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130487e34929b8f40d39fa94fd4c374aead to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130487e34929b8f40d39fa94fd4c374aead 2023-11-18 20:54:33,728 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018c725a6d22fd416cb94c0f1f6023bf6c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512018c725a6d22fd416cb94c0f1f6023bf6c 2023-11-18 20:54:33,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512051c46a4e8cda94b9996bc8ec8650c7fc5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512051c46a4e8cda94b9996bc8ec8650c7fc5 2023-11-18 20:54:33,729 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-18 20:54:33,729 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 20:54:33,730 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:33,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:33,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:33,731 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:33,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.3950 sec 2023-11-18 20:54:33,739 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0818667696a0f9030b3b6acc9f576231#family1#compaction#62 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:33,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_] to archive 2023-11-18 20:54:33,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:33,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0d5a461eaf2f459783e11db8e95cdd7b 2023-11-18 20:54:33,770 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-18 20:54:33,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f9862561874c4899b8487bab4555b7bd 2023-11-18 20:54:33,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4632959bfd7a46fa8fbd3ac4a2b47884 2023-11-18 20:54:33,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f6a14b60c47c4efe8d6f1ea5f31d124f 2023-11-18 20:54:33,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/a2a109fd12d04b7886bb333dedb5a5db 2023-11-18 20:54:33,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/28eeb031eaa54142bb710a44865df1ba 2023-11-18 20:54:33,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/bf7a35176fe545809ae6df833ebb47f5 2023-11-18 20:54:33,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b88290cd734041b19ad620acc86f8dff 2023-11-18 20:54:33,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/1ddc66026c52485298f643218161302e 2023-11-18 20:54:33,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/f576d7f0708f4fefa9b2e711884cf077_SeqId_44_ 2023-11-18 20:54:33,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 20:54:33,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:34,227 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:34,228 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:34,228 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:34,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-18 20:54:34,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE}] 2023-11-18 20:54:34,233 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE 2023-11-18 20:54:34,234 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:34,234 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340874234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340874234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340874234"}]},"ts":"1700340874234"} 2023-11-18 20:54:34,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:34,387 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:34,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:34,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0818667696a0f9030b3b6acc9f576231, disabling compactions & flushes 2023-11-18 20:54:34,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:34,956 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/.tmp/family1/0841199488444c77a24daeefa2a80a9a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0841199488444c77a24daeefa2a80a9a 2023-11-18 20:54:34,960 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0818667696a0f9030b3b6acc9f576231/family1 of 0818667696a0f9030b3b6acc9f576231 into 0841199488444c77a24daeefa2a80a9a(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:54:34,960 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:34,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:34,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:34,960 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1700340873722; duration=1sec 2023-11-18 20:54:34,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. after waiting 0 ms 2023-11-18 20:54:34,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:34,960 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:34,960 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b876bc737f07453ea84d69a7d3f07086, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_] to archive 2023-11-18 20:54:34,961 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:34,962 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/4c536595bafb44a0964f2b40c8d08df3 2023-11-18 20:54:34,963 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b876bc737f07453ea84d69a7d3f07086 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/b876bc737f07453ea84d69a7d3f07086 2023-11-18 20:54:34,964 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/2197db13097f4818a247502feabde767_SeqId_47_ 2023-11-18 20:54:34,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 20:54:34,970 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:34,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:34,970 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0818667696a0f9030b3b6acc9f576231 to self. 2023-11-18 20:54:34,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:34,972 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=CLOSED 2023-11-18 20:54:34,972 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340874972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340874972"}]},"ts":"1700340874972"} 2023-11-18 20:54:34,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-18 20:54:34,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897 in 738 msec 2023-11-18 20:54:34,975 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=true 2023-11-18 20:54:35,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:35,125 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340875125"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340875125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340875125"}]},"ts":"1700340875125"} 2023-11-18 20:54:35,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:35,278 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:35,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:35,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0818667696a0f9030b3b6acc9f576231, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:35,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:35,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,283 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,284 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:35,284 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:35,284 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0818667696a0f9030b3b6acc9f576231 columnFamilyName family1 2023-11-18 20:54:35,289 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0841199488444c77a24daeefa2a80a9a 2023-11-18 20:54:35,289 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(310): Store=0818667696a0f9030b3b6acc9f576231/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:35,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:35,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0818667696a0f9030b3b6acc9f576231; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66171842, jitterRate=-0.013962715864181519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:35,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:35,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., pid=47, masterSystemTime=1700340875278 2023-11-18 20:54:35,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:35,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:35,296 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:35,296 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340875296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340875296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340875296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340875296"}]},"ts":"1700340875296"} 2023-11-18 20:54:35,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-18 20:54:35,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897 in 170 msec 2023-11-18 20:54:35,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-18 20:54:35,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE in 1.0670 sec 2023-11-18 20:54:35,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-18 20:54:35,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0710 sec 2023-11-18 20:54:35,304 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4850 sec 2023-11-18 20:54:35,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-18 20:54:35,306 INFO [Listener at localhost/41997] compactions.TestMobCompactor(278): alter status finished 2023-11-18 20:54:35,306 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:35,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:35,308 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:35,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:35,309 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341475309 2023-11-18 20:54:35,309 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:35,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 20:54:35,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:35,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x24971003 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:35,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21ec40e9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:35,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:35,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:35,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:35,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:35,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:36,144 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128aa0ea3332cc9407b8127d8d364b35d41 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa0ea3332cc9407b8127d8d364b35d41 2023-11-18 20:54:36,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:36,158 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:36,159 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56022, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:36,165 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:36,167 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:36,176 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d428438f313d4ced915c5454b4e2f748 first=Optional[r05] last=Optional[r8] 2023-11-18 20:54:36,176 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d428438f313d4ced915c5454b4e2f748}] 2023-11-18 20:54:36,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d428438f313d4ced915c5454b4e2f748 for inclusion in 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:36,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 20:54:36,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:36,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d428438f313d4ced915c5454b4e2f748 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gco28m1uh2cebm2l8akjrjhvqn3p6tmh447o9542l3q823u9m4u7pqa8tcp4446j/family1/d428438f313d4ced915c5454b4e2f748 2023-11-18 20:54:36,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gco28m1uh2cebm2l8akjrjhvqn3p6tmh447o9542l3q823u9m4u7pqa8tcp4446j/family1/d428438f313d4ced915c5454b4e2f748 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/8024916322d54d049df8fe2605c20293_SeqId_53_ 2023-11-18 20:54:36,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gco28m1uh2cebm2l8akjrjhvqn3p6tmh447o9542l3q823u9m4u7pqa8tcp4446j/family1/d428438f313d4ced915c5454b4e2f748 into 0818667696a0f9030b3b6acc9f576231/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/8024916322d54d049df8fe2605c20293_SeqId_53_ - updating store file list. 2023-11-18 20:54:36,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/8024916322d54d049df8fe2605c20293_SeqId_53_ into 0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:36,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gco28m1uh2cebm2l8akjrjhvqn3p6tmh447o9542l3q823u9m4u7pqa8tcp4446j/family1/d428438f313d4ced915c5454b4e2f748 into 0818667696a0f9030b3b6acc9f576231/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/8024916322d54d049df8fe2605c20293_SeqId_53_) 2023-11-18 20:54:36,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gco28m1uh2cebm2l8akjrjhvqn3p6tmh447o9542l3q823u9m4u7pqa8tcp4446j/family1/d428438f313d4ced915c5454b4e2f748 2023-11-18 20:54:36,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:36,193 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:36,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb253de3459742b5adf3670961e6303d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120fb253de3459742b5adf3670961e6303d 2023-11-18 20:54:36,196 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bef2e3e2ef34047be92c705a5f97e9c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511285bef2e3e2ef34047be92c705a5f97e9c 2023-11-18 20:54:36,196 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-18 20:54:36,196 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 20:54:36,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:36,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:36,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:36,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:36,198 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:36,199 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 891 msec 2023-11-18 20:54:36,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:54:36,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:36,664 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-18 20:54:36,665 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:36,665 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-18 20:54:36,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-18 20:54:36,670 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE}] 2023-11-18 20:54:36,670 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE 2023-11-18 20:54:36,671 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:36,671 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340876671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340876671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340876671"}]},"ts":"1700340876671"} 2023-11-18 20:54:36,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:36,824 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:36,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:36,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0818667696a0f9030b3b6acc9f576231, disabling compactions & flushes 2023-11-18 20:54:36,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:36,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:36,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. after waiting 0 ms 2023-11-18 20:54:36,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:36,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-18 20:54:36,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:36,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:36,831 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0818667696a0f9030b3b6acc9f576231 to self. 2023-11-18 20:54:36,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:36,832 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=CLOSED 2023-11-18 20:54:36,832 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340876832"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340876832"}]},"ts":"1700340876832"} 2023-11-18 20:54:36,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-18 20:54:36,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897 in 160 msec 2023-11-18 20:54:36,835 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=true 2023-11-18 20:54:36,985 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:36,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340876985"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340876985"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340876985"}]},"ts":"1700340876985"} 2023-11-18 20:54:36,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:37,138 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:37,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:37,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0818667696a0f9030b3b6acc9f576231, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:37,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:37,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,143 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,143 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:37,143 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1 2023-11-18 20:54:37,144 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0818667696a0f9030b3b6acc9f576231 columnFamilyName family1 2023-11-18 20:54:37,149 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/0841199488444c77a24daeefa2a80a9a 2023-11-18 20:54:37,151 DEBUG [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/family1/8024916322d54d049df8fe2605c20293_SeqId_53_ 2023-11-18 20:54:37,152 INFO [StoreOpener-0818667696a0f9030b3b6acc9f576231-1] regionserver.HStore(310): Store=0818667696a0f9030b3b6acc9f576231/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:37,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:54:37,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0818667696a0f9030b3b6acc9f576231; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75139147, jitterRate=0.11966054141521454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:37,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:54:37,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231., pid=53, masterSystemTime=1700340877138 2023-11-18 20:54:37,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:37,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:54:37,159 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=0818667696a0f9030b3b6acc9f576231, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:37,159 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1700340877159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340877159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340877159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340877159"}]},"ts":"1700340877159"} 2023-11-18 20:54:37,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-18 20:54:37,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 0818667696a0f9030b3b6acc9f576231, server=jenkins-hbase4.apache.org,32871,1700340802897 in 173 msec 2023-11-18 20:54:37,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-18 20:54:37,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=0818667696a0f9030b3b6acc9f576231, REOPEN/MOVE in 492 msec 2023-11-18 20:54:37,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-18 20:54:37,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 496 msec 2023-11-18 20:54:37,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 910 msec 2023-11-18 20:54:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-18 20:54:37,168 INFO [Listener at localhost/41997] compactions.TestMobCompactor(278): alter status finished 2023-11-18 20:54:37,168 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-18 20:54:37,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:37,170 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:37,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:37,171 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341477171 2023-11-18 20:54:37,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:37,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-18 20:54:37,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:37,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x448f1fad to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:37,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@727e4dd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-18 20:54:37,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-18 20:54:37,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:37,179 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-18 20:54:37,180 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-11-18 20:54:37,225 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=249 (was 257), OpenFileDescriptor=649 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=135 (was 169), ProcessCount=173 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=20353 (was 20357) 2023-11-18 20:54:37,235 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=249, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=173, AvailableMemoryMB=20353 2023-11-18 20:54:37,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-18 20:54:37,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:37,238 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:37,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-18 20:54:37,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:37,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 20:54:37,240 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,241 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c empty. 2023-11-18 20:54:37,241 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,241 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-18 20:54:37,251 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:37,252 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => c08b8b8fa298f5c4abff74bf4bf6363c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:37,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 20:54:37,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing c08b8b8fa298f5c4abff74bf4bf6363c, disabling compactions & flushes 2023-11-18 20:54:37,657 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. after waiting 0 ms 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,657 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,657 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:37,659 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:37,660 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340877660"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340877660"}]},"ts":"1700340877660"} 2023-11-18 20:54:37,662 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:54:37,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:37,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340877662"}]},"ts":"1700340877662"} 2023-11-18 20:54:37,663 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-18 20:54:37,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, ASSIGN}] 2023-11-18 20:54:37,667 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, ASSIGN 2023-11-18 20:54:37,668 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:37,819 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:37,819 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340877819"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340877819"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340877819"}]},"ts":"1700340877819"} 2023-11-18 20:54:37,820 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:37,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 20:54:37,972 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:37,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c08b8b8fa298f5c4abff74bf4bf6363c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:37,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:37,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,976 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,977 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:37,977 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:37,978 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c08b8b8fa298f5c4abff74bf4bf6363c columnFamilyName family1 2023-11-18 20:54:37,979 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(310): Store=c08b8b8fa298f5c4abff74bf4bf6363c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:37,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:37,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:37,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c08b8b8fa298f5c4abff74bf4bf6363c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68126255, jitterRate=0.01516030728816986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:37,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:37,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., pid=57, masterSystemTime=1700340877972 2023-11-18 20:54:37,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:37,987 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:37,988 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340877987"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340877987"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340877987"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340877987"}]},"ts":"1700340877987"} 2023-11-18 20:54:37,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-18 20:54:37,990 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 169 msec 2023-11-18 20:54:37,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-18 20:54:37,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, ASSIGN in 324 msec 2023-11-18 20:54:37,992 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:37,992 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340877992"}]},"ts":"1700340877992"} 2023-11-18 20:54:37,993 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-18 20:54:37,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:37,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 758 msec 2023-11-18 20:54:38,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-18 20:54:38,343 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-18 20:54:38,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:38,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,362 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:38,362 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:38,362 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:38,362 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:38,363 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,363 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,364 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:38,364 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:38,364 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,365 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:38,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,365 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,367 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:38,367 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:38,367 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:38,367 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:38,368 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:54:38,387 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113031fe173d9da940a5a41a092393d8f38c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fe173d9da940a5a41a092393d8f38c 2023-11-18 20:54:38,791 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/1dfe7a8899da4420855b0fee6ecd89a6 2023-11-18 20:54:38,796 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/1dfe7a8899da4420855b0fee6ecd89a6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6 2023-11-18 20:54:38,799 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-18 20:54:38,800 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 432ms, sequenceid=5, compaction requested=false 2023-11-18 20:54:38,800 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:38,801 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:38,801 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:38,801 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:38,803 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,803 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:38,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:38,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c250fb0[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:38,805 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:38,805 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,806 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,806 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:38,806 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:38,806 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:38,806 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,806 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:38,808 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,808 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:38,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:38,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:38,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:38,811 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:38,811 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:38,811 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:38,811 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,811 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:38,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:38,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:38,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:38,815 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,816 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:38,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:38,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:38,819 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:38,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,819 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,919 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:38,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:38,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:38,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:38,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,925 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:38,925 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:38,925 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:38,925 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:38,926 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,926 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,929 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,929 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:38,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:38,929 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:38,929 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:38,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,930 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,930 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:38,930 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:38,930 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:38,930 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:38,930 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:38,930 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:38,930 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:38,931 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:38,931 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:38,931 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:54:39,342 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112829962ce564ae435c9150b67c5b7dc093 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112829962ce564ae435c9150b67c5b7dc093 2023-11-18 20:54:39,348 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/9d0106b4f25547328e7b4b2cde0b6dbd 2023-11-18 20:54:39,352 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/9d0106b4f25547328e7b4b2cde0b6dbd as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd 2023-11-18 20:54:39,355 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:54:39,356 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 425ms, sequenceid=9, compaction requested=false 2023-11-18 20:54:39,356 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:39,356 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:39,356 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,358 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,358 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:39,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:39,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:39,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60362ab5[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:39,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:39,360 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,361 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,361 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:39,361 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:39,361 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:39,361 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,361 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:39,362 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,362 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:39,362 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:39,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:39,362 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:39,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:39,365 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:39,365 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:39,365 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:39,365 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,365 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:39,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:39,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,367 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:39,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:39,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:39,368 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,370 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:39,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:39,372 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:39,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 20:54:39,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:39,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:39,372 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:39,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:39,472 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:39,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:39,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:39,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:39,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,478 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:39,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:39,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:39,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:39,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:39,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:39,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:39,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:39,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:39,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,481 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,481 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:39,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:39,481 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:39,481 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:39,481 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:39,481 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:39,896 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120108b2348bcc374935b4f14cd652379888 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120108b2348bcc374935b4f14cd652379888 2023-11-18 20:54:40,302 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/7a9da66a821541f387585e6915bcf89a 2023-11-18 20:54:40,306 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/7a9da66a821541f387585e6915bcf89a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a 2023-11-18 20:54:40,310 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a, entries=1, sequenceid=13, filesize=5.0 K 2023-11-18 20:54:40,311 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 830ms, sequenceid=13, compaction requested=true 2023-11-18 20:54:40,311 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:40,311 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:40,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:40,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:40,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:40,311 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:40,313 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:40,313 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:40,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ff10f0a[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:40,315 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:40,315 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,317 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:40,317 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:40,317 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,317 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:40,318 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:40,318 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:40,319 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:40,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:40,321 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:40,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:40,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:40,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,321 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:40,322 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,322 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,323 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:40,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:40,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:40,323 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:40,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,324 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:40,330 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:40,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:40,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:40,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:40,330 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:40,430 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:40,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:40,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:40,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:40,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,436 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:40,436 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:40,436 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:40,436 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:40,437 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,437 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,440 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,440 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:40,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:40,440 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:40,440 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:40,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,441 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,441 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:40,442 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:40,442 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:40,442 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:40,442 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:40,442 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:40,442 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:40,442 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:40,442 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:40,442 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:40,509 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:54:40,853 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205671c3142c7034da98f765ed6d59805a2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205671c3142c7034da98f765ed6d59805a2 2023-11-18 20:54:41,259 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/99d352987026495c9e119619cf28dfc8 2023-11-18 20:54:41,264 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/99d352987026495c9e119619cf28dfc8 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8 2023-11-18 20:54:41,268 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8, entries=1, sequenceid=17, filesize=5.0 K 2023-11-18 20:54:41,268 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 826ms, sequenceid=17, compaction requested=true 2023-11-18 20:54:41,268 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:41,269 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:41,269 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:41,269 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:41,269 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,269 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:41,269 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:41,270 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,270 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:41,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:41,271 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,271 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:41,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64cb571f[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:41,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:41,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,274 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:41,274 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:41,274 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,274 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:41,275 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:41,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:41,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:41,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:41,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:41,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:41,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:41,277 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:41,277 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:41,277 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:41,277 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,277 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:41,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:41,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:41,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:41,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,280 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:41,281 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:41,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:41,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:41,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:41,283 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:41,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:41,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:41,283 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,383 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:41,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:41,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:41,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:41,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,389 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:41,389 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:41,389 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:41,389 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:41,389 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,389 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,392 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:41,392 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:41,392 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:41,392 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:41,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,393 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,393 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:41,393 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:41,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:41,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:41,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:41,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:41,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:41,393 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:41,393 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:41,394 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:41,805 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228dbaf13b065494ef6b98917dcacdb32c4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dbaf13b065494ef6b98917dcacdb32c4 2023-11-18 20:54:42,210 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/5ef59e0255da4779b8f9ec90a7673f25 2023-11-18 20:54:42,215 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/5ef59e0255da4779b8f9ec90a7673f25 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25 2023-11-18 20:54:42,219 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25, entries=1, sequenceid=21, filesize=5.0 K 2023-11-18 20:54:42,220 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 826ms, sequenceid=21, compaction requested=true 2023-11-18 20:54:42,220 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:42,220 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:42,220 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:42,222 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,222 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:42,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:42,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70878cb9[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:42,224 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:42,224 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,225 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:42,225 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:42,225 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,225 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:42,226 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:42,226 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:42,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:42,229 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:42,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:42,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:42,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,229 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:42,232 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,232 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,232 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:42,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,235 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,237 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:42,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 20:54:42,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:42,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,237 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,238 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,238 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:42,238 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:42,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:42,338 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:42,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:42,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:42,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:42,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,344 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:42,344 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:42,344 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:42,344 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:42,344 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,345 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,346 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,346 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:42,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:42,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:42,346 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:42,346 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:42,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:42,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:42,347 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:42,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:42,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:42,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:42,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:42,347 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:42,347 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:42,347 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:42,348 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:42,762 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231460e07b86f2240898ed852ec251bfb55 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231460e07b86f2240898ed852ec251bfb55 2023-11-18 20:54:43,104 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-18 20:54:43,168 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/36f0fcc6c0bf4b69950c23222cb1423b 2023-11-18 20:54:43,174 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/36f0fcc6c0bf4b69950c23222cb1423b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b 2023-11-18 20:54:43,178 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-18 20:54:43,179 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 831ms, sequenceid=25, compaction requested=true 2023-11-18 20:54:43,179 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:43,179 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:43,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:43,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:43,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:43,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:43,185 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,185 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:43,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:43,186 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,186 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:43,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:43,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:43,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:43,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:43,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21b5639e[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:43,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:43,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,193 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,193 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:43,193 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:43,193 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:43,194 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,194 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:43,199 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:43,199 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,199 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:43,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:43,199 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:43,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:43,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:43,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:43,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:43,202 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:43,202 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:43,202 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:43,202 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,202 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:43,207 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,207 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:43,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:43,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,207 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:43,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:43,207 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,209 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:43,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,212 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:43,212 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:43,213 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,213 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:43,213 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:43,213 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:43,313 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:43,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:43,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:43,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:43,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,319 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:43,319 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:43,319 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:43,319 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:43,320 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,320 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,321 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:43,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:43,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:43,321 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:43,322 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,322 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:43,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:43,323 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:43,323 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:43,323 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:43,323 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:43,735 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017788f810ceae4c228fd6db536b031351 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017788f810ceae4c228fd6db536b031351 2023-11-18 20:54:44,140 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/8648731499394514b1637270cf1c4a96 2023-11-18 20:54:44,144 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/8648731499394514b1637270cf1c4a96 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96 2023-11-18 20:54:44,148 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96, entries=1, sequenceid=29, filesize=5.0 K 2023-11-18 20:54:44,149 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 826ms, sequenceid=29, compaction requested=true 2023-11-18 20:54:44,149 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:44,149 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:44,149 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:44,150 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,150 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:44,151 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:44,151 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:44,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:44,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@564bb1fd[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:44,152 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:44,152 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,153 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,154 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:44,154 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:44,154 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:44,154 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,154 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:44,156 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:44,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:44,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:44,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:44,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:44,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:44,158 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:44,158 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:44,158 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:44,158 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,158 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:44,159 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,159 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:44,159 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:44,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:44,160 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,161 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:44,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 20:54:44,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:44,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:44,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:44,163 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,164 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,164 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:44,164 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:44,164 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:44,164 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:44,264 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:44,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:44,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,270 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:44,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:44,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:44,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:44,270 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,271 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,272 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:44,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:44,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:44,272 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:44,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:44,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,273 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:44,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:44,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:44,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:44,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:44,281 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:44,281 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:44,281 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:44,281 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:44,281 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:44,694 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010326335064403649d8a6f83d18abc03f43 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010326335064403649d8a6f83d18abc03f43 2023-11-18 20:54:45,099 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/f9a9ac26196e46f09fe7cd044cfd33be 2023-11-18 20:54:45,103 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/f9a9ac26196e46f09fe7cd044cfd33be as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be 2023-11-18 20:54:45,107 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be, entries=1, sequenceid=33, filesize=5.0 K 2023-11-18 20:54:45,108 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 827ms, sequenceid=33, compaction requested=true 2023-11-18 20:54:45,108 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:45,108 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:45,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:45,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:45,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:45,108 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:45,110 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,110 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:45,110 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,110 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:45,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:45,112 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:45,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68066784[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:45,112 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,113 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:45,113 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,113 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:45,118 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:45,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:45,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:45,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:45,120 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:45,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:45,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:45,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,120 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:45,122 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,122 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:45,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,122 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:45,122 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,124 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:45,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:45,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:45,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:45,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-18 20:54:45,126 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:45,126 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:45,127 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:45,127 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:45,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:45,227 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:45,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:45,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:45,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:45,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,233 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:45,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:45,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:45,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:45,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,233 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,234 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:45,234 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:45,235 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:45,235 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:45,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:45,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,236 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,236 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:45,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:45,236 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:45,236 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:45,236 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:45,236 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:45,648 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907824236e14cce4181b4370a807e3459c2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907824236e14cce4181b4370a807e3459c2 2023-11-18 20:54:46,053 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/e3ba7fe87c0742bca825b89a3f3b16d9 2023-11-18 20:54:46,058 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/e3ba7fe87c0742bca825b89a3f3b16d9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9 2023-11-18 20:54:46,061 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9, entries=1, sequenceid=37, filesize=5.0 K 2023-11-18 20:54:46,062 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 826ms, sequenceid=37, compaction requested=true 2023-11-18 20:54:46,062 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:46,062 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:46,062 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:46,063 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:46,063 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,063 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:46,063 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:46,065 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,065 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:46,065 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,065 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:46,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:46,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24a8cc79[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:46,067 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:46,067 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,068 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,068 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:46,068 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:46,068 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:46,068 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,068 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:46,069 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:46,069 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:46,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:46,072 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:46,072 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:46,072 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:46,072 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,072 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:46,073 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,073 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,073 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:46,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:46,074 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,075 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:46,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,078 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,078 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:46,078 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,079 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:46,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:46,078 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:46,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:46,079 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:46,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:46,179 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:46,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:46,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:46,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-18 20:54:46,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,185 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:46,185 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:46,185 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-18 20:54:46,185 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-18 20:54:46,185 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,185 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,186 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,186 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:46,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:46,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:46,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,187 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-18 20:54:46,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-18 20:54:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-18 20:54:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:54:46,188 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:46,188 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:46,188 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. started... 2023-11-18 20:54:46,188 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c08b8b8fa298f5c4abff74bf4bf6363c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:54:46,602 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c4d7570373ae425ba40b3973cd49b84b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4d7570373ae425ba40b3973cd49b84b 2023-11-18 20:54:47,007 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/02095b2c2c2147eabe8fd653056cf353 2023-11-18 20:54:47,011 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/02095b2c2c2147eabe8fd653056cf353 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353 2023-11-18 20:54:47,015 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353, entries=1, sequenceid=41, filesize=5.0 K 2023-11-18 20:54:47,015 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c08b8b8fa298f5c4abff74bf4bf6363c in 827ms, sequenceid=41, compaction requested=true 2023-11-18 20:54:47,015 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:47,015 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:47,015 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:54:47,015 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:54:47,015 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-18 20:54:47,016 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-18 20:54:47,017 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:47,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,017 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:54:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:47,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-18 20:54:47,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e8bf2e1[Count = 0] remaining members to acquire global barrier 2023-11-18 20:54:47,019 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-18 20:54:47,019 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,020 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,020 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-18 20:54:47,020 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-18 20:54:47,020 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:54:47,020 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,020 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:54:47,022 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,022 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,023 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:47,023 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:47,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:54:47,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-18 20:54:47,025 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-18 20:54:47,025 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:54:47,025 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:54:47,025 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,025 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:54:47,026 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,026 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:54:47,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:54:47,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,026 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:54:47,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:47,027 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:54:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,028 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:54:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:47,032 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:54:47,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-18 20:54:47,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:47,032 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:54:47,033 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:47,033 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,033 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,033 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-18 20:54:47,033 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:54:47,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:54:47,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:54:47,133 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:54:47,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:54:47,135 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:47,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:47,137 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:47,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:47,137 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341487137 2023-11-18 20:54:47,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:47,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 20:54:47,139 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:47,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x1dbfa444 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:47,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32d200f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:47,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:47,979 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c84adb0c44f54baeb8c6187a13aecb8b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c84adb0c44f54baeb8c6187a13aecb8b 2023-11-18 20:54:47,980 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:47,992 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:47,993 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:48,001 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:48,002 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46138, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:48,010 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 first=Optional[r3] last=Optional[r6] 2023-11-18 20:54:48,010 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01}] 2023-11-18 20:54:48,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 for inclusion in c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:48,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-18 20:54:48,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:48,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:48,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d7co68cbqp92trm464m9ts6968hqs1ns6n8onq5o5f3umdu9l6fooi7073p7jrm3/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 2023-11-18 20:54:48,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d7co68cbqp92trm464m9ts6968hqs1ns6n8onq5o5f3umdu9l6fooi7073p7jrm3/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_ 2023-11-18 20:54:48,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d7co68cbqp92trm464m9ts6968hqs1ns6n8onq5o5f3umdu9l6fooi7073p7jrm3/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_ - updating store file list. 2023-11-18 20:54:48,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_ into c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:48,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d7co68cbqp92trm464m9ts6968hqs1ns6n8onq5o5f3umdu9l6fooi7073p7jrm3/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_) 2023-11-18 20:54:48,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__d7co68cbqp92trm464m9ts6968hqs1ns6n8onq5o5f3umdu9l6fooi7073p7jrm3/family1/9588a3cd4d814ba6a1c43f3bd7b0eb01 2023-11-18 20:54:48,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:54:48,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:54:48,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): c08b8b8fa298f5c4abff74bf4bf6363c/family1 is initiating minor compaction 2023-11-18 20:54:48,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@108d8b33; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:48,028 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c08b8b8fa298f5c4abff74bf4bf6363c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:48,028 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp, totalSize=50.3 K 2023-11-18 20:54:48,028 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 9d0106b4f25547328e7b4b2cde0b6dbd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:54:48,028 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 7a9da66a821541f387585e6915bcf89a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:54:48,028 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 99d352987026495c9e119619cf28dfc8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:54:48,028 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 5ef59e0255da4779b8f9ec90a7673f25, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 36f0fcc6c0bf4b69950c23222cb1423b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 8648731499394514b1637270cf1c4a96, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f9a9ac26196e46f09fe7cd044cfd33be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting e3ba7fe87c0742bca825b89a3f3b16d9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 02095b2c2c2147eabe8fd653056cf353, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:54:48,029 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 302ee55a3d8f405997611f038787704c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:54:48,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:48,031 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:48,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dbaf13b065494ef6b98917dcacdb32c4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228dbaf13b065494ef6b98917dcacdb32c4 2023-11-18 20:54:48,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231460e07b86f2240898ed852ec251bfb55 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231460e07b86f2240898ed852ec251bfb55 2023-11-18 20:54:48,035 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017788f810ceae4c228fd6db536b031351 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601017788f810ceae4c228fd6db536b031351 2023-11-18 20:54:48,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010326335064403649d8a6f83d18abc03f43 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010326335064403649d8a6f83d18abc03f43 2023-11-18 20:54:48,037 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-18 20:54:48,037 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-18 20:54:48,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,038 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,067 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): c08b8b8fa298f5c4abff74bf4bf6363c#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:48,889 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/0efe065951fa43ae958ee4b83f410d0a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/0efe065951fa43ae958ee4b83f410d0a 2023-11-18 20:54:48,893 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c08b8b8fa298f5c4abff74bf4bf6363c/family1 of c08b8b8fa298f5c4abff74bf4bf6363c into 0efe065951fa43ae958ee4b83f410d0a(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:48,893 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:48,893 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1700340888028; duration=0sec 2023-11-18 20:54:48,893 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:48,899 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120555acf0e5bcfd4b8aa9b8b43893968324 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120555acf0e5bcfd4b8aa9b8b43893968324 2023-11-18 20:54:48,900 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:48,922 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/161249984d83424fb6d051629302fcf2 first=Optional[r00] last=Optional[r2] 2023-11-18 20:54:48,922 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/161249984d83424fb6d051629302fcf2}] 2023-11-18 20:54:48,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/161249984d83424fb6d051629302fcf2 for inclusion in c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:48,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-18 20:54:48,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:48,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:48,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/161249984d83424fb6d051629302fcf2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8qnq1l2hd7c3lcrdsi7ftsdohkpusjfiao26dh02nig0gcejkh6fab80qg7rqunt/family1/161249984d83424fb6d051629302fcf2 2023-11-18 20:54:48,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8qnq1l2hd7c3lcrdsi7ftsdohkpusjfiao26dh02nig0gcejkh6fab80qg7rqunt/family1/161249984d83424fb6d051629302fcf2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_ 2023-11-18 20:54:48,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8qnq1l2hd7c3lcrdsi7ftsdohkpusjfiao26dh02nig0gcejkh6fab80qg7rqunt/family1/161249984d83424fb6d051629302fcf2 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_ - updating store file list. 2023-11-18 20:54:48,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_ into c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:48,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8qnq1l2hd7c3lcrdsi7ftsdohkpusjfiao26dh02nig0gcejkh6fab80qg7rqunt/family1/161249984d83424fb6d051629302fcf2 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_) 2023-11-18 20:54:48,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__8qnq1l2hd7c3lcrdsi7ftsdohkpusjfiao26dh02nig0gcejkh6fab80qg7rqunt/family1/161249984d83424fb6d051629302fcf2 2023-11-18 20:54:48,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:54:48,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:54:48,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): c08b8b8fa298f5c4abff74bf4bf6363c/family1 is initiating minor compaction (all files) 2023-11-18 20:54:48,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5de776f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:48,936 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c08b8b8fa298f5c4abff74bf4bf6363c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:48,936 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/0efe065951fa43ae958ee4b83f410d0a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp, totalSize=388.1 K 2023-11-18 20:54:48,937 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 1dfe7a8899da4420855b0fee6ecd89a6, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:54:48,937 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 0efe065951fa43ae958ee4b83f410d0a, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:54:48,938 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 605d691345394ae690b31d8fe3bfc769_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878826804 2023-11-18 20:54:48,938 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:48,939 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:48,940 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fe173d9da940a5a41a092393d8f38c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113031fe173d9da940a5a41a092393d8f38c 2023-11-18 20:54:48,941 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120108b2348bcc374935b4f14cd652379888 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120108b2348bcc374935b4f14cd652379888 2023-11-18 20:54:48,943 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205671c3142c7034da98f765ed6d59805a2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205671c3142c7034da98f765ed6d59805a2 2023-11-18 20:54:48,943 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-18 20:54:48,943 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-18 20:54:48,943 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:48,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:48,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:48,945 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:48,946 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8100 sec 2023-11-18 20:54:48,956 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): c08b8b8fa298f5c4abff74bf4bf6363c#family1#compaction#74 average throughput is 17.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:48,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_] to archive 2023-11-18 20:54:48,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:48,980 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 29 more 2023-11-18 20:54:48,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/9d0106b4f25547328e7b4b2cde0b6dbd 2023-11-18 20:54:48,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/7a9da66a821541f387585e6915bcf89a 2023-11-18 20:54:48,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/99d352987026495c9e119619cf28dfc8 2023-11-18 20:54:48,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/5ef59e0255da4779b8f9ec90a7673f25 2023-11-18 20:54:48,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/36f0fcc6c0bf4b69950c23222cb1423b 2023-11-18 20:54:48,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/8648731499394514b1637270cf1c4a96 2023-11-18 20:54:48,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f9a9ac26196e46f09fe7cd044cfd33be 2023-11-18 20:54:48,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/e3ba7fe87c0742bca825b89a3f3b16d9 2023-11-18 20:54:48,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/02095b2c2c2147eabe8fd653056cf353 2023-11-18 20:54:48,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/302ee55a3d8f405997611f038787704c_SeqId_44_ 2023-11-18 20:54:49,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 20:54:49,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:49,431 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:49,432 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:49,432 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:49,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-18 20:54:49,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE}] 2023-11-18 20:54:49,437 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE 2023-11-18 20:54:49,437 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:49,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340889437"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340889437"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340889437"}]},"ts":"1700340889437"} 2023-11-18 20:54:49,439 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:49,590 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:49,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:49,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c08b8b8fa298f5c4abff74bf4bf6363c, disabling compactions & flushes 2023-11-18 20:54:49,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:49,792 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/.tmp/family1/f4d139e048e1414c8e4237b958cf403c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f4d139e048e1414c8e4237b958cf403c 2023-11-18 20:54:49,796 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c08b8b8fa298f5c4abff74bf4bf6363c/family1 of c08b8b8fa298f5c4abff74bf4bf6363c into f4d139e048e1414c8e4237b958cf403c(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:49,796 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:49,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:49,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:49,796 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1700340888936; duration=0sec 2023-11-18 20:54:49,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. after waiting 0 ms 2023-11-18 20:54:49,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:49,796 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:49,799 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/0efe065951fa43ae958ee4b83f410d0a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_] to archive 2023-11-18 20:54:49,799 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:49,801 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/1dfe7a8899da4420855b0fee6ecd89a6 2023-11-18 20:54:49,802 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/0efe065951fa43ae958ee4b83f410d0a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/0efe065951fa43ae958ee4b83f410d0a 2023-11-18 20:54:49,803 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/605d691345394ae690b31d8fe3bfc769_SeqId_47_ 2023-11-18 20:54:49,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 20:54:49,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:49,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:49,808 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: c08b8b8fa298f5c4abff74bf4bf6363c to self. 2023-11-18 20:54:49,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:49,809 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=CLOSED 2023-11-18 20:54:49,809 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340889809"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340889809"}]},"ts":"1700340889809"} 2023-11-18 20:54:49,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-18 20:54:49,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 371 msec 2023-11-18 20:54:49,812 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=true 2023-11-18 20:54:49,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:49,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340889962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340889962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340889962"}]},"ts":"1700340889962"} 2023-11-18 20:54:49,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:50,115 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:50,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:50,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c08b8b8fa298f5c4abff74bf4bf6363c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:50,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:50,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,119 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,120 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:50,120 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:50,120 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c08b8b8fa298f5c4abff74bf4bf6363c columnFamilyName family1 2023-11-18 20:54:50,125 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f4d139e048e1414c8e4237b958cf403c 2023-11-18 20:54:50,125 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(310): Store=c08b8b8fa298f5c4abff74bf4bf6363c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:50,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:50,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c08b8b8fa298f5c4abff74bf4bf6363c; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60372651, jitterRate=-0.1003773957490921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:50,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:50,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., pid=63, masterSystemTime=1700340890115 2023-11-18 20:54:50,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:50,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:50,133 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:50,133 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340890132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340890132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340890132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340890132"}]},"ts":"1700340890132"} 2023-11-18 20:54:50,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-18 20:54:50,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 170 msec 2023-11-18 20:54:50,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-18 20:54:50,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE in 699 msec 2023-11-18 20:54:50,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-18 20:54:50,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 703 msec 2023-11-18 20:54:50,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1180 sec 2023-11-18 20:54:50,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-18 20:54:50,141 INFO [Listener at localhost/41997] compactions.TestMobCompactor(278): alter status finished 2023-11-18 20:54:50,142 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:50,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:50,144 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:50,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:50,145 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341490145 2023-11-18 20:54:50,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:50,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 20:54:50,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:50,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x1e9a6a88 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:50,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12004b62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:50,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:50,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:50,156 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:50,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:50,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:50,980 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282fd3635cf0e54d5a8425787ef6167bb2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511282fd3635cf0e54d5a8425787ef6167bb2 2023-11-18 20:54:50,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:50,993 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:50,994 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:51,000 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:51,001 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:51,009 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34adbf06d7ae4bdd99b0e175389cb144 first=Optional[r05] last=Optional[r8] 2023-11-18 20:54:51,009 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34adbf06d7ae4bdd99b0e175389cb144}] 2023-11-18 20:54:51,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34adbf06d7ae4bdd99b0e175389cb144 for inclusion in c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:51,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-18 20:54:51,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:51,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:51,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/34adbf06d7ae4bdd99b0e175389cb144 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9d7hnof4ti1vsiq44etscqkrjbbegl31hr7pv5ua50bhdko8phdmgj5064bb1nfm/family1/34adbf06d7ae4bdd99b0e175389cb144 2023-11-18 20:54:51,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9d7hnof4ti1vsiq44etscqkrjbbegl31hr7pv5ua50bhdko8phdmgj5064bb1nfm/family1/34adbf06d7ae4bdd99b0e175389cb144 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/660b2ed3f5064c1083e033d827da461a_SeqId_53_ 2023-11-18 20:54:51,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9d7hnof4ti1vsiq44etscqkrjbbegl31hr7pv5ua50bhdko8phdmgj5064bb1nfm/family1/34adbf06d7ae4bdd99b0e175389cb144 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/660b2ed3f5064c1083e033d827da461a_SeqId_53_ - updating store file list. 2023-11-18 20:54:51,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/660b2ed3f5064c1083e033d827da461a_SeqId_53_ into c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:51,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9d7hnof4ti1vsiq44etscqkrjbbegl31hr7pv5ua50bhdko8phdmgj5064bb1nfm/family1/34adbf06d7ae4bdd99b0e175389cb144 into c08b8b8fa298f5c4abff74bf4bf6363c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/660b2ed3f5064c1083e033d827da461a_SeqId_53_) 2023-11-18 20:54:51,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9d7hnof4ti1vsiq44etscqkrjbbegl31hr7pv5ua50bhdko8phdmgj5064bb1nfm/family1/34adbf06d7ae4bdd99b0e175389cb144 2023-11-18 20:54:51,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:51,024 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:51,025 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4d7570373ae425ba40b3973cd49b84b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4d7570373ae425ba40b3973cd49b84b 2023-11-18 20:54:51,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112829962ce564ae435c9150b67c5b7dc093 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112829962ce564ae435c9150b67c5b7dc093 2023-11-18 20:54:51,026 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-18 20:54:51,026 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 20:54:51,026 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:51,026 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:51,026 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:51,026 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:51,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:51,027 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:51,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 884 msec 2023-11-18 20:54:51,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-18 20:54:51,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:51,489 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-18 20:54:51,490 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-18 20:54:51,490 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-18 20:54:51,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-18 20:54:51,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE}] 2023-11-18 20:54:51,495 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE 2023-11-18 20:54:51,495 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:51,496 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340891495"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340891495"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340891495"}]},"ts":"1700340891495"} 2023-11-18 20:54:51,497 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:51,648 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:51,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c08b8b8fa298f5c4abff74bf4bf6363c, disabling compactions & flushes 2023-11-18 20:54:51,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. after waiting 0 ms 2023-11-18 20:54:51,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,653 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-18 20:54:51,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:51,654 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3510): Not adding moved region record: c08b8b8fa298f5c4abff74bf4bf6363c to self. 2023-11-18 20:54:51,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,655 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=CLOSED 2023-11-18 20:54:51,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340891655"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340891655"}]},"ts":"1700340891655"} 2023-11-18 20:54:51,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-18 20:54:51,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 160 msec 2023-11-18 20:54:51,658 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=true 2023-11-18 20:54:51,808 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:51,809 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340891808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340891808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340891808"}]},"ts":"1700340891808"} 2023-11-18 20:54:51,810 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:51,961 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:51,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c08b8b8fa298f5c4abff74bf4bf6363c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:51,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:51,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,965 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,966 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:51,966 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1 2023-11-18 20:54:51,967 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c08b8b8fa298f5c4abff74bf4bf6363c columnFamilyName family1 2023-11-18 20:54:51,971 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/660b2ed3f5064c1083e033d827da461a_SeqId_53_ 2023-11-18 20:54:51,974 DEBUG [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/family1/f4d139e048e1414c8e4237b958cf403c 2023-11-18 20:54:51,974 INFO [StoreOpener-c08b8b8fa298f5c4abff74bf4bf6363c-1] regionserver.HStore(310): Store=c08b8b8fa298f5c4abff74bf4bf6363c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:51,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:54:51,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c08b8b8fa298f5c4abff74bf4bf6363c; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65022055, jitterRate=-0.031095877289772034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:51,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:54:51,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c., pid=69, masterSystemTime=1700340891961 2023-11-18 20:54:51,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:54:51,982 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c08b8b8fa298f5c4abff74bf4bf6363c, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:51,982 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1700340891982"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340891982"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340891982"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340891982"}]},"ts":"1700340891982"} 2023-11-18 20:54:51,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-18 20:54:51,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure c08b8b8fa298f5c4abff74bf4bf6363c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 173 msec 2023-11-18 20:54:51,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-18 20:54:51,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=c08b8b8fa298f5c4abff74bf4bf6363c, REOPEN/MOVE in 490 msec 2023-11-18 20:54:51,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-18 20:54:51,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 494 msec 2023-11-18 20:54:51,989 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 907 msec 2023-11-18 20:54:51,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-18 20:54:51,991 INFO [Listener at localhost/41997] compactions.TestMobCompactor(278): alter status finished 2023-11-18 20:54:51,992 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-18 20:54:51,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:51,994 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:51,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:51,995 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341491995 2023-11-18 20:54:51,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:54:51,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-18 20:54:51,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:51,998 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x38c1b62b to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:52,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@df449fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-18 20:54:52,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-18 20:54:52,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:52,005 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-18 20:54:52,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 12 msec 2023-11-18 20:54:52,050 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=257 (was 249) - Thread LEAK? -, OpenFileDescriptor=679 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=113 (was 135), ProcessCount=173 (was 173), AvailableMemoryMB=20328 (was 20353) 2023-11-18 20:54:52,062 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=257, OpenFileDescriptor=679, MaxFileDescriptor=60000, SystemLoadAverage=113, ProcessCount=173, AvailableMemoryMB=20328 2023-11-18 20:54:52,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 20:54:52,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:52,068 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:52,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-18 20:54:52,069 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:52,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:52,070 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:52,070 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd empty. 2023-11-18 20:54:52,071 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:52,071 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-18 20:54:52,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:52,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:52,479 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:52,480 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a7a45c205370de16db7bbebe3c803dd, NAME => 'testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:52,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 9a7a45c205370de16db7bbebe3c803dd, disabling compactions & flushes 2023-11-18 20:54:52,886 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. after waiting 0 ms 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:52,886 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:52,886 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:52,888 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:52,889 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700340892889"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340892889"}]},"ts":"1700340892889"} 2023-11-18 20:54:52,890 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:54:52,890 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:52,890 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340892890"}]},"ts":"1700340892890"} 2023-11-18 20:54:52,891 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-18 20:54:52,894 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, ASSIGN}] 2023-11-18 20:54:52,895 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, ASSIGN 2023-11-18 20:54:52,896 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:53,047 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=9a7a45c205370de16db7bbebe3c803dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:53,047 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700340893047"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340893047"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340893047"}]},"ts":"1700340893047"} 2023-11-18 20:54:53,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 9a7a45c205370de16db7bbebe3c803dd, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:53,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:53,200 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:53,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:53,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a7a45c205370de16db7bbebe3c803dd, NAME => 'testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:54:53,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-18 20:54:53,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-18 20:54:53,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:53,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,206 INFO [StoreOpener-9a7a45c205370de16db7bbebe3c803dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,207 DEBUG [StoreOpener-9a7a45c205370de16db7bbebe3c803dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1 2023-11-18 20:54:53,207 DEBUG [StoreOpener-9a7a45c205370de16db7bbebe3c803dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1 2023-11-18 20:54:53,207 INFO [StoreOpener-9a7a45c205370de16db7bbebe3c803dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a7a45c205370de16db7bbebe3c803dd columnFamilyName f1 2023-11-18 20:54:53,208 INFO [StoreOpener-9a7a45c205370de16db7bbebe3c803dd-1] regionserver.HStore(310): Store=9a7a45c205370de16db7bbebe3c803dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:53,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:53,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a7a45c205370de16db7bbebe3c803dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68860279, jitterRate=0.026098117232322693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:54:53,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:53,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd., pid=73, masterSystemTime=1700340893199 2023-11-18 20:54:53,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:53,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:53,215 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=9a7a45c205370de16db7bbebe3c803dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:53,216 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700340893215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340893215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340893215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340893215"}]},"ts":"1700340893215"} 2023-11-18 20:54:53,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-18 20:54:53,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 9a7a45c205370de16db7bbebe3c803dd, server=jenkins-hbase4.apache.org,32871,1700340802897 in 169 msec 2023-11-18 20:54:53,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-18 20:54:53,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, ASSIGN in 324 msec 2023-11-18 20:54:53,219 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:53,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340893219"}]},"ts":"1700340893219"} 2023-11-18 20:54:53,220 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-18 20:54:53,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:53,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1560 sec 2023-11-18 20:54:54,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-18 20:54:54,173 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-18 20:54:54,173 DEBUG [Listener at localhost/41997] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-18 20:54:54,175 INFO [Listener at localhost/41997] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-18 20:54:54,178 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-18 20:54:54,179 INFO [Listener at localhost/41997] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-18 20:54:54,179 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-18 20:54:54,182 INFO [Listener at localhost/41997] regionserver.HRegion(2745): Flushing 9a7a45c205370de16db7bbebe3c803dd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-18 20:54:54,594 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c4813dd73b8d491a911d19dc3add7c94 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c4813dd73b8d491a911d19dc3add7c94 2023-11-18 20:54:54,999 INFO [Listener at localhost/41997] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp/f1/20f1053308464880be5edcc3ace980ba 2023-11-18 20:54:55,004 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp/f1/20f1053308464880be5edcc3ace980ba as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba 2023-11-18 20:54:55,007 INFO [Listener at localhost/41997] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba, entries=1, sequenceid=5, filesize=4.9 K 2023-11-18 20:54:55,008 INFO [Listener at localhost/41997] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 9a7a45c205370de16db7bbebe3c803dd in 826ms, sequenceid=5, compaction requested=false 2023-11-18 20:54:55,008 DEBUG [Listener at localhost/41997] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-18 20:54:55,009 DEBUG [Listener at localhost/41997] regionserver.HRegion(2446): Flush status journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:55,010 INFO [Listener at localhost/41997] regionserver.HRegion(2745): Flushing 9a7a45c205370de16db7bbebe3c803dd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-18 20:54:55,158 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x448f1fad to 127.0.0.1:55479 2023-11-18 20:54:55,158 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-18 20:54:55,158 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,159 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:55,159 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e9a6a88 to 127.0.0.1:55479 2023-11-18 20:54:55,159 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,159 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38c1b62b to 127.0.0.1:55479 2023-11-18 20:54:55,159 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,159 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:55,159 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50f0baab to 127.0.0.1:55479 2023-11-18 20:54:55,159 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,159 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:55,159 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1dbfa444 to 127.0.0.1:55479 2023-11-18 20:54:55,160 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,160 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:55,160 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24971003 to 127.0.0.1:55479 2023-11-18 20:54:55,160 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,160 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:54:55,160 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0262aca6 to 127.0.0.1:55479 2023-11-18 20:54:55,160 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:54:55,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:54:55,422 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118cfc8f4e11b004ecbaf597c7649cd06a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118cfc8f4e11b004ecbaf597c7649cd06a3 2023-11-18 20:54:55,827 INFO [Listener at localhost/41997] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp/f1/23deea23c7aa4491842dbab6a0782665 2023-11-18 20:54:55,831 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp/f1/23deea23c7aa4491842dbab6a0782665 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665 2023-11-18 20:54:55,835 INFO [Listener at localhost/41997] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665, entries=1, sequenceid=9, filesize=4.9 K 2023-11-18 20:54:55,836 INFO [Listener at localhost/41997] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 9a7a45c205370de16db7bbebe3c803dd in 826ms, sequenceid=9, compaction requested=false 2023-11-18 20:54:55,836 DEBUG [Listener at localhost/41997] regionserver.HRegion(2446): Flush status journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:55,837 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-18 20:54:55,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 20:54:55,839 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 20:54:55,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:55,840 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341495840 2023-11-18 20:54:55,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:54:55,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-18 20:54:55,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-18 20:54:55,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x707c06ff to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:54:55,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fe8329a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:54:55,846 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testGetAfterCompaction' and column='f1' 2023-11-18 20:54:55,889 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:55,889 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:55,939 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:55,939 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:55,990 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:55,990 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,041 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,041 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,091 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,091 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,142 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,142 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,193 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,193 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,243 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,243 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,294 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,294 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,345 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,345 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,395 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,395 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,446 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,446 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,497 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,497 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,548 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,548 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,598 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,598 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,649 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,649 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,668 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118b023a71e5f134e148f63922f95b149b8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118b023a71e5f134e148f63922f95b149b8 2023-11-18 20:54:56,669 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testGetAfterCompaction' column='f1' 2023-11-18 20:54:56,682 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:54:56,683 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:54:56,689 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:54:56,691 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:54:56,698 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/0a6a0abc162044a4b4c2c65c5e0aac66 first=Optional[r1] last=Optional[r2] 2023-11-18 20:54:56,699 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{f1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/0a6a0abc162044a4b4c2c65c5e0aac66}] 2023-11-18 20:54:56,700 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,700 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/0a6a0abc162044a4b4c2c65c5e0aac66 for inclusion in 9a7a45c205370de16db7bbebe3c803dd/f1 2023-11-18 20:54:56,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-18 20:54:56,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:54:56,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:56,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/f1/0a6a0abc162044a4b4c2c65c5e0aac66 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testGetAfterCompaction__tprjpo0jdo1i3jhr1th08pvudlrtp9ccib3mar7qgu9i8s5vk08cnuljn9d557k2/f1/0a6a0abc162044a4b4c2c65c5e0aac66 2023-11-18 20:54:56,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testGetAfterCompaction__tprjpo0jdo1i3jhr1th08pvudlrtp9ccib3mar7qgu9i8s5vk08cnuljn9d557k2/f1/0a6a0abc162044a4b4c2c65c5e0aac66 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_ 2023-11-18 20:54:56,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testGetAfterCompaction__tprjpo0jdo1i3jhr1th08pvudlrtp9ccib3mar7qgu9i8s5vk08cnuljn9d557k2/f1/0a6a0abc162044a4b4c2c65c5e0aac66 into 9a7a45c205370de16db7bbebe3c803dd/f1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_ - updating store file list. 2023-11-18 20:54:56,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_ into 9a7a45c205370de16db7bbebe3c803dd/f1 2023-11-18 20:54:56,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testGetAfterCompaction__tprjpo0jdo1i3jhr1th08pvudlrtp9ccib3mar7qgu9i8s5vk08cnuljn9d557k2/f1/0a6a0abc162044a4b4c2c65c5e0aac66 into 9a7a45c205370de16db7bbebe3c803dd/f1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_) 2023-11-18 20:54:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testGetAfterCompaction__tprjpo0jdo1i3jhr1th08pvudlrtp9ccib3mar7qgu9i8s5vk08cnuljn9d557k2/f1/0a6a0abc162044a4b4c2c65c5e0aac66 2023-11-18 20:54:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(1912): 9a7a45c205370de16db7bbebe3c803dd/f1 is initiating minor compaction 2023-11-18 20:54:56,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2c7838da; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:56,711 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 9a7a45c205370de16db7bbebe3c803dd/f1 in testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:56,711 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp, totalSize=10.0 K 2023-11-18 20:54:56,711 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 23deea23c7aa4491842dbab6a0782665, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:54:56,711 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 87c36c65cdf541adabf20d41e2c77443_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:54:56,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testGetAfterCompaction' column='f1' 2023-11-18 20:54:56,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:56,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c4813dd73b8d491a911d19dc3add7c94 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118c4813dd73b8d491a911d19dc3add7c94 2023-11-18 20:54:56,718 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9a7a45c205370de16db7bbebe3c803dd#f1#compaction#77 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:54:56,719 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118cfc8f4e11b004ecbaf597c7649cd06a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118cfc8f4e11b004ecbaf597c7649cd06a3 2023-11-18 20:54:56,719 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-18 20:54:56,719 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 20:54:56,719 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testGetAfterCompaction' and column='f1' 2023-11-18 20:54:56,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-18 20:54:56,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:54:56,720 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-18 20:54:56,721 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 882 msec 2023-11-18 20:54:56,751 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,751 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,751 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:56,754 DEBUG [Listener at localhost/41997] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-18 20:54:56,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-18 20:54:56,758 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=32871] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:56,758 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-18 20:54:56,758 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-18 20:54:56,758 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=32871] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-18 20:54:56,758 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=32871] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. because compaction request was cancelled 2023-11-18 20:54:56,810 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,810 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,810 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:56,860 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,860 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,860 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:56,911 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,911 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,911 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:56,962 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,962 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:56,962 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:57,013 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,013 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,013 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:57,064 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,064 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,064 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:57,114 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,114 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,114 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:57,134 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/.tmp/f1/77a60d6d534c48e49eb5ae0bebd7c4bb as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/77a60d6d534c48e49eb5ae0bebd7c4bb 2023-11-18 20:54:57,139 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 9a7a45c205370de16db7bbebe3c803dd/f1 of 9a7a45c205370de16db7bbebe3c803dd into 77a60d6d534c48e49eb5ae0bebd7c4bb(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:54:57,139 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:57,139 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1700340896711; duration=0sec 2023-11-18 20:54:57,139 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:54:57,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_] to archive 2023-11-18 20:54:57,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:54:57,165 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,165 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340895827; access_time=1700340895012; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,165 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/77a60d6d534c48e49eb5ae0bebd7c4bb; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700340897130; access_time=1700340896716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,165 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1700340896664; access_time=1700340895857; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-18 20:54:57,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/23deea23c7aa4491842dbab6a0782665 2023-11-18 20:54:57,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/87c36c65cdf541adabf20d41e2c77443_SeqId_12_ 2023-11-18 20:54:57,216 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1700340894999; access_time=1700340894185; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,216 INFO [Listener at localhost/41997] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/77a60d6d534c48e49eb5ae0bebd7c4bb; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1700340897130; access_time=1700340896716; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-18 20:54:57,331 INFO [Listener at localhost/41997] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-18 20:54:57,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-18 20:54:57,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,345 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340897345"}]},"ts":"1700340897345"} 2023-11-18 20:54:57,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-18 20:54:57,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 20:54:57,347 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-18 20:54:57,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, UNASSIGN}] 2023-11-18 20:54:57,350 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, UNASSIGN 2023-11-18 20:54:57,350 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9a7a45c205370de16db7bbebe3c803dd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:57,350 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700340897350"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340897350"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340897350"}]},"ts":"1700340897350"} 2023-11-18 20:54:57,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 9a7a45c205370de16db7bbebe3c803dd, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:57,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 20:54:57,503 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:57,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:57,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a7a45c205370de16db7bbebe3c803dd, disabling compactions & flushes 2023-11-18 20:54:57,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:57,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:57,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. after waiting 0 ms 2023-11-18 20:54:57,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:57,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-18 20:54:57,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-18 20:54:57,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd. 2023-11-18 20:54:57,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a7a45c205370de16db7bbebe3c803dd: 2023-11-18 20:54:57,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:57,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=9a7a45c205370de16db7bbebe3c803dd, regionState=CLOSED 2023-11-18 20:54:57,511 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1700340897510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340897510"}]},"ts":"1700340897510"} 2023-11-18 20:54:57,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-18 20:54:57,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 9a7a45c205370de16db7bbebe3c803dd, server=jenkins-hbase4.apache.org,32871,1700340802897 in 161 msec 2023-11-18 20:54:57,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-18 20:54:57,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=9a7a45c205370de16db7bbebe3c803dd, UNASSIGN in 164 msec 2023-11-18 20:54:57,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340897515"}]},"ts":"1700340897515"} 2023-11-18 20:54:57,516 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-18 20:54:57,519 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-18 20:54:57,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 181 msec 2023-11-18 20:54:57,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-18 20:54:57,648 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-18 20:54:57,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-18 20:54:57,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,660 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,661 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-18 20:54:57,664 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:57,666 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1, FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/recovered.edits] 2023-11-18 20:54:57,670 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/20f1053308464880be5edcc3ace980ba 2023-11-18 20:54:57,671 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/77a60d6d534c48e49eb5ae0bebd7c4bb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/f1/77a60d6d534c48e49eb5ae0bebd7c4bb 2023-11-18 20:54:57,673 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/recovered.edits/15.seqid to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd/recovered.edits/15.seqid 2023-11-18 20:54:57,673 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testGetAfterCompaction/9a7a45c205370de16db7bbebe3c803dd 2023-11-18 20:54:57,673 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-18 20:54:57,674 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-18 20:54:57,674 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-18 20:54:57,677 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118b023a71e5f134e148f63922f95b149b8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231118b023a71e5f134e148f63922f95b149b8 2023-11-18 20:54:57,678 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-18 20:54:57,680 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,710 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-18 20:54:57,713 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-18 20:54:57,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,714 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-18 20:54:57,714 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700340897714"}]},"ts":"9223372036854775807"} 2023-11-18 20:54:57,715 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-18 20:54:57,715 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9a7a45c205370de16db7bbebe3c803dd, NAME => 'testGetAfterCompaction,,1700340892066.9a7a45c205370de16db7bbebe3c803dd.', STARTKEY => '', ENDKEY => ''}] 2023-11-18 20:54:57,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-18 20:54:57,716 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1700340897716"}]},"ts":"9223372036854775807"} 2023-11-18 20:54:57,717 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-18 20:54:57,719 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-18 20:54:57,720 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 65 msec 2023-11-18 20:54:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-18 20:54:57,763 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-18 20:54:57,776 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 257), OpenFileDescriptor=628 (was 679), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=141 (was 113) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=20308 (was 20328) 2023-11-18 20:54:57,785 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=141, ProcessCount=173, AvailableMemoryMB=20307 2023-11-18 20:54:57,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 20:54:57,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-18 20:54:57,789 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:54:57,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-18 20:54:57,789 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:54:57,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:57,791 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:57,791 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:57,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 empty. 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc empty. 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 empty. 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:57,792 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:57,792 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-18 20:54:57,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:58,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:58,203 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-18 20:54:58,204 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => dbb912a5b612e2ba3e6bd669ef8c1b88, NAME => 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:58,205 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => a58f913bb6e2f707eed0b258698334cc, NAME => 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:58,205 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => f5b54a9ca2bc73b4fe66796d83446d01, NAME => 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:54:58,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:58,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing dbb912a5b612e2ba3e6bd669ef8c1b88, disabling compactions & flushes 2023-11-18 20:54:58,615 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. after waiting 0 ms 2023-11-18 20:54:58,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,616 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,616 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing f5b54a9ca2bc73b4fe66796d83446d01, disabling compactions & flushes 2023-11-18 20:54:58,619 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. after waiting 0 ms 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,619 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,619 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:54:58,621 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,621 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing a58f913bb6e2f707eed0b258698334cc, disabling compactions & flushes 2023-11-18 20:54:58,621 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,622 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,622 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. after waiting 0 ms 2023-11-18 20:54:58,622 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,622 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,622 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:54:58,624 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:54:58,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340898624"}]},"ts":"1700340898624"} 2023-11-18 20:54:58,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340898624"}]},"ts":"1700340898624"} 2023-11-18 20:54:58,625 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340898624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340898624"}]},"ts":"1700340898624"} 2023-11-18 20:54:58,627 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 20:54:58,627 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:54:58,627 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340898627"}]},"ts":"1700340898627"} 2023-11-18 20:54:58,628 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-18 20:54:58,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN}] 2023-11-18 20:54:58,633 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN 2023-11-18 20:54:58,634 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN 2023-11-18 20:54:58,634 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN 2023-11-18 20:54:58,634 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:58,634 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:58,634 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:54:58,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340898785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340898785"}]},"ts":"1700340898785"} 2023-11-18 20:54:58,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340898785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340898785"}]},"ts":"1700340898785"} 2023-11-18 20:54:58,786 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340898785"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340898785"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340898785"}]},"ts":"1700340898785"} 2023-11-18 20:54:58,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:58,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:58,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:54:58,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:58,940 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5b54a9ca2bc73b4fe66796d83446d01, NAME => 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 20:54:58,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,944 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,945 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:54:58,945 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:54:58,946 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5b54a9ca2bc73b4fe66796d83446d01 columnFamilyName family1 2023-11-18 20:54:58,947 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(310): Store=f5b54a9ca2bc73b4fe66796d83446d01/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,947 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,948 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2 2023-11-18 20:54:58,948 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2 2023-11-18 20:54:58,948 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5b54a9ca2bc73b4fe66796d83446d01 columnFamilyName family2 2023-11-18 20:54:58,949 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(310): Store=f5b54a9ca2bc73b4fe66796d83446d01/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:58,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:54:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:58,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f5b54a9ca2bc73b4fe66796d83446d01; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70103328, jitterRate=0.04462099075317383}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:58,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:54:58,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., pid=83, masterSystemTime=1700340898940 2023-11-18 20:54:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:58,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbb912a5b612e2ba3e6bd669ef8c1b88, NAME => 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 20:54:58,957 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,957 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898957"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340898957"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340898957"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340898957"}]},"ts":"1700340898957"} 2023-11-18 20:54:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,959 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,960 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:54:58,960 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:54:58,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-11-18 20:54:58,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897 in 172 msec 2023-11-18 20:54:58,960 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb912a5b612e2ba3e6bd669ef8c1b88 columnFamilyName family1 2023-11-18 20:54:58,961 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN in 329 msec 2023-11-18 20:54:58,961 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(310): Store=dbb912a5b612e2ba3e6bd669ef8c1b88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,962 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,963 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2 2023-11-18 20:54:58,963 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2 2023-11-18 20:54:58,963 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb912a5b612e2ba3e6bd669ef8c1b88 columnFamilyName family2 2023-11-18 20:54:58,964 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(310): Store=dbb912a5b612e2ba3e6bd669ef8c1b88/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:58,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:54:58,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:58,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbb912a5b612e2ba3e6bd669ef8c1b88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68679101, jitterRate=0.023398354649543762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:58,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:54:58,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., pid=84, masterSystemTime=1700340898940 2023-11-18 20:54:58,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:58,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a58f913bb6e2f707eed0b258698334cc, NAME => 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 20:54:58,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,971 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:54:58,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,972 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340898971"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340898971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340898971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340898971"}]},"ts":"1700340898971"} 2023-11-18 20:54:58,973 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-11-18 20:54:58,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897 in 185 msec 2023-11-18 20:54:58,975 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:54:58,975 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:54:58,975 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a58f913bb6e2f707eed0b258698334cc columnFamilyName family1 2023-11-18 20:54:58,976 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN in 343 msec 2023-11-18 20:54:58,976 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(310): Store=a58f913bb6e2f707eed0b258698334cc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,977 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,978 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2 2023-11-18 20:54:58,978 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2 2023-11-18 20:54:58,978 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a58f913bb6e2f707eed0b258698334cc columnFamilyName family2 2023-11-18 20:54:58,979 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(310): Store=a58f913bb6e2f707eed0b258698334cc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:54:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:54:58,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:54:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:54:58,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a58f913bb6e2f707eed0b258698334cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65257436, jitterRate=-0.02758842706680298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:54:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:54:58,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., pid=85, masterSystemTime=1700340898940 2023-11-18 20:54:58,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:58,986 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:58,986 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340898986"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340898986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340898986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340898986"}]},"ts":"1700340898986"} 2023-11-18 20:54:58,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=81 2023-11-18 20:54:58,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897 in 199 msec 2023-11-18 20:54:58,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=79 2023-11-18 20:54:58,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN in 357 msec 2023-11-18 20:54:58,990 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:54:58,990 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340898990"}]},"ts":"1700340898990"} 2023-11-18 20:54:58,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-18 20:54:58,994 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:54:58,995 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2070 sec 2023-11-18 20:54:59,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-18 20:54:59,894 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-18 20:54:59,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:54:59,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:54:59,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:54:59,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:54:59,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 20:54:59,909 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 20:54:59,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:59,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 20:54:59,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 20:54:59,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:54:59,910 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:54:59,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:59,911 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:54:59,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:54:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:54:59,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:54:59,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:54:59,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:54:59,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:54:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:54:59,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:54:59,912 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 20:54:59,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 20:54:59,912 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 20:54:59,912 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:54:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 20:54:59,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:54:59,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:54:59,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:54:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:54:59,914 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:54:59,914 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5b54a9ca2bc73b4fe66796d83446d01 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:54:59,913 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:54:59,914 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:54:59,914 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:54:59,914 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a58f913bb6e2f707eed0b258698334cc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:54:59,915 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing dbb912a5b612e2ba3e6bd669ef8c1b88 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:54:59,928 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 2023-11-18 20:54:59,929 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 2023-11-18 20:54:59,936 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/658f7c0ee0e142afb53e2d53f902f7b4 2023-11-18 20:55:00,328 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e 2023-11-18 20:55:00,336 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/ac3176d95a744d28be12d8b1b1cbdbb9 2023-11-18 20:55:00,350 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433 2023-11-18 20:55:00,733 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 2023-11-18 20:55:00,749 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97 2023-11-18 20:55:00,753 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/e322ac8594494d4e878c88d4cc039a1b 2023-11-18 20:55:00,758 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/658f7c0ee0e142afb53e2d53f902f7b4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4 2023-11-18 20:55:00,762 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:00,763 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/e322ac8594494d4e878c88d4cc039a1b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b 2023-11-18 20:55:00,767 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:00,768 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for dbb912a5b612e2ba3e6bd669ef8c1b88 in 853ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:00,768 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-18 20:55:00,768 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:00,768 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:00,768 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:01,147 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8 2023-11-18 20:55:01,154 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/16d5d74c5d9044e09e19bed4c5937ed2 2023-11-18 20:55:01,157 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/ac3176d95a744d28be12d8b1b1cbdbb9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9 2023-11-18 20:55:01,160 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:01,161 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/16d5d74c5d9044e09e19bed4c5937ed2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2 2023-11-18 20:55:01,164 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:01,165 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a58f913bb6e2f707eed0b258698334cc in 1251ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:01,166 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:01,166 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:01,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:01,552 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/5ae044d6bda842b18b0d1216a5036734 2023-11-18 20:55:01,557 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 2023-11-18 20:55:01,561 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:01,562 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/5ae044d6bda842b18b0d1216a5036734 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734 2023-11-18 20:55:01,571 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:01,572 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f5b54a9ca2bc73b4fe66796d83446d01 in 1658ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:01,572 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:01,572 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 20:55:01,572 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 20:55:01,574 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:01,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,574 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:01,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:01,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 20:55:01,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25447a94[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:01,576 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 20:55:01,576 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,577 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 20:55:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 20:55:01,577 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:01,577 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,577 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:01,579 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,579 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 20:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,579 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:01,579 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 20:55:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:01,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 20:55:01,582 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 20:55:01,582 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:01,582 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:01,582 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 20:55:01,582 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:01,583 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,583 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:01,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,583 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:01,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:01,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:01,584 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,586 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:01,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:01,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:01,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:01,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 20:55:01,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:01,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:01,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:01,589 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:01,589 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:01,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:01,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:01,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-18 20:55:01,589 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,589 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:01,589 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,689 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:01,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:01,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:01,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:01,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:01,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:01,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:01,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 20:55:01,695 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 20:55:01,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:01,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 20:55:01,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 20:55:01,696 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,696 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:01,697 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,697 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:01,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:01,698 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:01,698 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:01,698 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:01,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 20:55:01,699 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 20:55:01,699 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 20:55:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 20:55:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 20:55:01,699 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:01,699 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:01,699 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:55:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:01,699 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:01,700 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:55:01,699 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:55:01,700 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a58f913bb6e2f707eed0b258698334cc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:01,700 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing dbb912a5b612e2ba3e6bd669ef8c1b88 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:01,700 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5b54a9ca2bc73b4fe66796d83446d01 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:01,718 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a 2023-11-18 20:55:01,719 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c 2023-11-18 20:55:01,728 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/219e1768d83d48cf869aaabe1178646d 2023-11-18 20:55:01,749 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9 2023-11-18 20:55:02,118 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 2023-11-18 20:55:02,126 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/33f5b54ae4454abf90c71f07938ddb2a 2023-11-18 20:55:02,129 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/58213579abb24acbb44a28461e41d985 2023-11-18 20:55:02,170 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/e0f566f7ab7449989b34d278962aa502 2023-11-18 20:55:02,175 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/219e1768d83d48cf869aaabe1178646d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d 2023-11-18 20:55:02,180 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:02,181 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/e0f566f7ab7449989b34d278962aa502 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502 2023-11-18 20:55:02,185 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:02,186 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a58f913bb6e2f707eed0b258698334cc in 487ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:02,186 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:02,186 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:02,186 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:02,556 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481 2023-11-18 20:55:02,556 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f 2023-11-18 20:55:02,561 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/8fbfb0eeddad422d85e64fa53b70d73b 2023-11-18 20:55:02,561 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/8a64a7fd83324249894f6aa3b213f6e1 2023-11-18 20:55:02,565 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/33f5b54ae4454abf90c71f07938ddb2a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a 2023-11-18 20:55:02,565 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/58213579abb24acbb44a28461e41d985 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985 2023-11-18 20:55:02,569 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:02,569 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:02,569 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/8a64a7fd83324249894f6aa3b213f6e1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1 2023-11-18 20:55:02,570 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/8fbfb0eeddad422d85e64fa53b70d73b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b 2023-11-18 20:55:02,574 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:02,574 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:02,574 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f5b54a9ca2bc73b4fe66796d83446d01 in 874ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:02,574 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for dbb912a5b612e2ba3e6bd669ef8c1b88 in 874ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 20:55:02,575 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 20:55:02,579 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,579 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:02,580 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:02,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:02,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 20:55:02,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e2513ff[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:02,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 20:55:02,581 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,582 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 20:55:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 20:55:02,582 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:02,582 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,582 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 20:55:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:02,585 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,585 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:02,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 20:55:02,587 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 20:55:02,587 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:02,587 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:02,587 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 20:55:02,587 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:02,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:02,588 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:02,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:02,589 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:02,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 20:55:02,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:02,592 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,593 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:02,593 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-18 20:55:02,592 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:02,593 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:02,593 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:02,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:02,693 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:02,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:02,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:02,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:02,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:02,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:02,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:02,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 20:55:02,700 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 20:55:02,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:02,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 20:55:02,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 20:55:02,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:02,701 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,701 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:02,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:02,702 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:02,702 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:02,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:02,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 20:55:02,703 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 20:55:02,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 20:55:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 20:55:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:55:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:02,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:02,703 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5b54a9ca2bc73b4fe66796d83446d01 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:55:02,703 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:55:02,703 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing dbb912a5b612e2ba3e6bd669ef8c1b88 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:02,703 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a58f913bb6e2f707eed0b258698334cc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:03,010 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:55:03,115 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 2023-11-18 20:55:03,115 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f 2023-11-18 20:55:03,115 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 2023-11-18 20:55:03,524 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/d1847298bac44a09bb878a1932a48777 2023-11-18 20:55:03,524 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/04267bf50252477b8b913b4bfc0820c0 2023-11-18 20:55:03,524 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/a8bbfed79a5948c3ba75d295cbf233d4 2023-11-18 20:55:03,548 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d 2023-11-18 20:55:03,948 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed 2023-11-18 20:55:03,955 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/7e124fd968ca4e629f061f0a0be7af7f 2023-11-18 20:55:03,960 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/1518794407964981831bd9adc2f53657 2023-11-18 20:55:03,960 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/d1847298bac44a09bb878a1932a48777 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777 2023-11-18 20:55:03,961 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639 2023-11-18 20:55:03,965 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:03,965 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/04267bf50252477b8b913b4bfc0820c0 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0 2023-11-18 20:55:03,966 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/7e124fd968ca4e629f061f0a0be7af7f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f 2023-11-18 20:55:03,971 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:03,971 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:03,971 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/1518794407964981831bd9adc2f53657 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657 2023-11-18 20:55:03,971 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for dbb912a5b612e2ba3e6bd669ef8c1b88 in 1268ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:03,971 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:03,971 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:03,971 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:03,986 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:03,987 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f5b54a9ca2bc73b4fe66796d83446d01 in 1284ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:03,987 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:03,987 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:03,987 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:04,374 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/9a5dc57c2342434e9165fe7626ef3719 2023-11-18 20:55:04,379 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/a8bbfed79a5948c3ba75d295cbf233d4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4 2023-11-18 20:55:04,382 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:04,383 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/9a5dc57c2342434e9165fe7626ef3719 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719 2023-11-18 20:55:04,386 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:04,387 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a58f913bb6e2f707eed0b258698334cc in 1684ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:04,387 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:04,387 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 20:55:04,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 20:55:04,390 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,390 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:04,390 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,390 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:04,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:04,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 20:55:04,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c8cc346[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:04,392 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 20:55:04,392 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,393 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 20:55:04,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 20:55:04,393 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:04,393 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,393 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 20:55:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:04,395 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,395 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:04,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 20:55:04,397 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 20:55:04,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:04,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:04,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 20:55:04,397 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:04,399 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,399 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:04,399 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:04,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:04,400 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,401 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:04,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:04,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:04,409 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:04,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:04,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:04,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 20:55:04,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:04,409 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:04,410 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:04,510 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:04,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:04,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:04,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:04,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:04,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:04,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:04,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 20:55:04,517 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 20:55:04,517 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:04,517 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 20:55:04,517 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 20:55:04,517 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,517 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:04,518 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,518 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:04,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:04,519 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:04,519 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:04,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:04,519 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:04,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:04,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 20:55:04,520 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 20:55:04,520 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 20:55:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 20:55:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 20:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:04,520 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:04,521 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:55:04,521 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5b54a9ca2bc73b4fe66796d83446d01 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:04,521 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing dbb912a5b612e2ba3e6bd669ef8c1b88 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:04,520 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:55:04,521 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a58f913bb6e2f707eed0b258698334cc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:04,542 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 2023-11-18 20:55:04,938 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 2023-11-18 20:55:04,940 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e 2023-11-18 20:55:04,946 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/6ac776fe4654458a9f29faa9387b687a 2023-11-18 20:55:04,958 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1 2023-11-18 20:55:04,965 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/d930f04e4ae14f899fb94afd452e27f9 2023-11-18 20:55:04,970 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/6ac776fe4654458a9f29faa9387b687a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a 2023-11-18 20:55:04,973 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:04,974 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/d930f04e4ae14f899fb94afd452e27f9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9 2023-11-18 20:55:04,977 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:04,978 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f5b54a9ca2bc73b4fe66796d83446d01 in 458ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:04,978 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:04,978 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:04,978 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:05,343 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/fe28ba4024c044f58442e9fd91b433d1 2023-11-18 20:55:05,345 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/a4be93f8cfd34f74a7c52b098339e735 2023-11-18 20:55:05,759 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb 2023-11-18 20:55:05,759 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd 2023-11-18 20:55:06,164 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/5b9de12d7d134aa7a88f38fadd80f15c 2023-11-18 20:55:06,164 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/84034ef749fc404c9df5abc9aa379f1e 2023-11-18 20:55:06,168 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/a4be93f8cfd34f74a7c52b098339e735 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735 2023-11-18 20:55:06,168 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/fe28ba4024c044f58442e9fd91b433d1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1 2023-11-18 20:55:06,172 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:06,172 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:06,172 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/5b9de12d7d134aa7a88f38fadd80f15c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c 2023-11-18 20:55:06,173 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/84034ef749fc404c9df5abc9aa379f1e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e 2023-11-18 20:55:06,176 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:06,176 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:06,177 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for dbb912a5b612e2ba3e6bd669ef8c1b88 in 1656ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:06,177 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a58f913bb6e2f707eed0b258698334cc in 1656ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:06,177 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:06,177 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:06,177 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:06,177 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 20:55:06,177 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 20:55:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,179 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 20:55:06,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d6136cc[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:06,181 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 20:55:06,181 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,183 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 20:55:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 20:55:06,183 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:06,183 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,183 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:06,184 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 20:55:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:06,185 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 20:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:06,188 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 20:55:06,188 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:06,188 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:06,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 20:55:06,188 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 20:55:06,188 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:06,190 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,190 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:06,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,190 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:06,191 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,192 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,194 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,194 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:06,194 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:06,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 20:55:06,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:06,195 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:06,195 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:06,295 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:06,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:06,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:06,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700340906308 (current time:1700340906308). 2023-11-18 20:55:06,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-18 20:55:06,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] zookeeper.ReadOnlyZKClient(139): Connect 0x7fd11fef to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:06,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f29eee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:06,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:06,324 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fd11fef to 127.0.0.1:55479 2023-11-18 20:55:06,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-18 20:55:06,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:06,336 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot, current working dir path: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/snaptb-1700340906297 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-18 20:55:06,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:06,344 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:06,345 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700341506345 2023-11-18 20:55:06,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:06,346 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1700340906297 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-18 20:55:06,347 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:06,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 20:55:06,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-18 20:55:06,349 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 20:55:06,350 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1700341506350 2023-11-18 20:55:06,363 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:06,363 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-18 20:55:06,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1700340906297 2023-11-18 20:55:06,367 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1700340906297' 2023-11-18 20:55:06,367 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-18 20:55:06,368 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1700340906297' starting 'acquire' 2023-11-18 20:55:06,368 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1700340906297', kicking off acquire phase on members. 2023-11-18 20:55:06,368 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,368 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1700340906297 2023-11-18 20:55:06,369 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,369 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-18 20:55:06,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-18 20:55:06,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 20:55:06,370 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,370 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:06,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1700340906297 2023-11-18 20:55:06,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-18 20:55:06,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1700340906297 2023-11-18 20:55:06,371 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1700340906297 from table testCompactionWithHFileLink type FLUSH 2023-11-18 20:55:06,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1700340906297 2023-11-18 20:55:06,380 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1700340906297' with timeout 300000ms 2023-11-18 20:55:06,380 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-18 20:55:06,380 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1700340906297' starting 'acquire' stage 2023-11-18 20:55:06,380 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1700340906297' locally acquired 2023-11-18 20:55:06,380 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (snaptb-1700340906297) in zk 2023-11-18 20:55:06,383 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,383 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 20:55:06,384 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,384 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1700340906297' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'snaptb-1700340906297' on coordinator 2023-11-18 20:55:06,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b77712e[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:06,385 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1700340906297' starting 'in-barrier' execution. 2023-11-18 20:55:06,385 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,387 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,387 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1700340906297' received 'reached' from coordinator. 2023-11-18 20:55:06,387 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,387 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:06,388 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:06,389 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:55:06,389 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:06,390 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.' region-info for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,391 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:06,391 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.' region-info for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,392 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:06,392 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:06,392 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.' region-info for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,398 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 20:55:06,398 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 20:55:06,398 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a] hfiles 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735] hfiles 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1] hfiles 2023-11-18 20:55:06,403 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c] hfiles 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9] hfiles 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e] hfiles 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,409 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719 for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,410 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,440 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. completed. 2023-11-18 20:55:06,440 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:06,440 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-18 20:55:06,463 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:06,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:06,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:06,467 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-18 20:55:06,667 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:06,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:06,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:06,668 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-18 20:55:06,830 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. completed. 2023-11-18 20:55:06,830 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. completed. 2023-11-18 20:55:06,830 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:06,830 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1700340906297' locally completed 2023-11-18 20:55:06,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1700340906297' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:06,832 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1700340906297' has notified controller of completion 2023-11-18 20:55:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 20:55:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:06,832 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1700340906297' completed. 2023-11-18 20:55:06,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1700340906297' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:06,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'snaptb-1700340906297', counting down latch. Waiting for 0 more 2023-11-18 20:55:06,834 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1700340906297' execution completed 2023-11-18 20:55:06,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:06,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:06,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1700340906297 2023-11-18 20:55:06,834 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1700340906297including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-18 20:55:06,836 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,836 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-18 20:55:06,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,836 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-18 20:55:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:06,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-18 20:55:06,837 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 20:55:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:06,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,838 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:06,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1700340906297 2023-11-18 20:55:06,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700340906297 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-18 20:55:06,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-18 20:55:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-18 20:55:06,846 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1700340906297 2023-11-18 20:55:06,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1700340906297 2023-11-18 20:55:06,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1700340906297 because node does not exist (not an error) 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700340906297/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:06,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-18 20:55:06,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-18 20:55:06,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-18 20:55:06,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1700340906297 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1700340906297 2023-11-18 20:55:06,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1700340906297 2023-11-18 20:55:06,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269] mob files 2023-11-18 20:55:06,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e 2023-11-18 20:55:06,848 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1] mob files 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d 2023-11-18 20:55:06,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1 2023-11-18 20:55:06,968 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:06,969 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-18 20:55:07,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1700340906297 2023-11-18 20:55:07,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/snaptb-1700340906297 2023-11-18 20:55:07,469 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:07,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:07,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:07,470 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-18 20:55:07,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/snaptb-1700340906297 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/snaptb-1700340906297 2023-11-18 20:55:07,707 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1700340906297 of table testCompactionWithHFileLink completed 2023-11-18 20:55:07,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/snaptb-1700340906297 2023-11-18 20:55:07,708 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/snaptb-1700340906297 2023-11-18 20:55:07,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1700340906297 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700340906346Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1700340907255 (+909 ms)Consolidate snapshot: snaptb-1700340906297 at 1700340907255Loading Region manifests for snaptb-1700340906297 at 1700340907255Writing data manifest for snaptb-1700340906297 at 1700340907273 (+18 ms)Verifying snapshot: snaptb-1700340906297 at 1700340907683 (+410 ms)Snapshot snaptb-1700340906297 of table testCompactionWithHFileLink completed at 1700340907707 (+24 ms) 2023-11-18 20:55:07,709 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-18 20:55:07,710 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3610 sec 2023-11-18 20:55:08,470 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:08,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:08,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-18 20:55:08,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:08,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:08,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-18 20:55:08,504 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-18 20:55:08,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:08,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-18 20:55:08,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-18 20:55:08,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:08,505 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:08,506 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:08,506 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:08,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:08,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:08,507 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:08,507 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-18 20:55:08,507 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-18 20:55:08,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-18 20:55:08,508 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-18 20:55:08,508 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:08,508 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. started... 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:08,508 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:08,508 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:08,508 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f5b54a9ca2bc73b4fe66796d83446d01 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. started... 2023-11-18 20:55:08,508 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. started... 2023-11-18 20:55:08,508 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing dbb912a5b612e2ba3e6bd669ef8c1b88 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:08,508 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a58f913bb6e2f707eed0b258698334cc 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:08,922 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/3c26c2a29a2a42ef9775783d0229107a 2023-11-18 20:55:08,925 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c26c2a29a2a42ef9775783d0229107a 2023-11-18 20:55:09,323 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/883c1231c5b746cc8a55b3beb2306967 2023-11-18 20:55:09,323 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/53f9ab3ccc33498387d2da9ff8a9b3a6 2023-11-18 20:55:09,327 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 883c1231c5b746cc8a55b3beb2306967 2023-11-18 20:55:09,327 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53f9ab3ccc33498387d2da9ff8a9b3a6 2023-11-18 20:55:09,737 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/90782451725c4f408220bece667248f5 2023-11-18 20:55:09,742 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90782451725c4f408220bece667248f5 2023-11-18 20:55:09,742 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/3c26c2a29a2a42ef9775783d0229107a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a 2023-11-18 20:55:09,746 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c26c2a29a2a42ef9775783d0229107a 2023-11-18 20:55:09,746 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:09,747 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/90782451725c4f408220bece667248f5 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5 2023-11-18 20:55:09,751 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90782451725c4f408220bece667248f5 2023-11-18 20:55:09,751 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:09,752 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a58f913bb6e2f707eed0b258698334cc in 1244ms, sequenceid=24, compaction requested=true 2023-11-18 20:55:09,752 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:09,752 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:09,752 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:10,140 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/b5457327c452494fa393ac3798e1007d 2023-11-18 20:55:10,143 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/8e103199e9e34d06be72bf0ed0266bbf 2023-11-18 20:55:10,144 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5457327c452494fa393ac3798e1007d 2023-11-18 20:55:10,145 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/883c1231c5b746cc8a55b3beb2306967 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967 2023-11-18 20:55:10,147 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e103199e9e34d06be72bf0ed0266bbf 2023-11-18 20:55:10,147 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/53f9ab3ccc33498387d2da9ff8a9b3a6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6 2023-11-18 20:55:10,148 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 883c1231c5b746cc8a55b3beb2306967 2023-11-18 20:55:10,148 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:10,149 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/b5457327c452494fa393ac3798e1007d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d 2023-11-18 20:55:10,151 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53f9ab3ccc33498387d2da9ff8a9b3a6 2023-11-18 20:55:10,151 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6, entries=3, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:10,152 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/8e103199e9e34d06be72bf0ed0266bbf as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf 2023-11-18 20:55:10,152 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5457327c452494fa393ac3798e1007d 2023-11-18 20:55:10,152 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:10,153 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f5b54a9ca2bc73b4fe66796d83446d01 in 1645ms, sequenceid=24, compaction requested=true 2023-11-18 20:55:10,153 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:10,153 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:10,153 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:10,155 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e103199e9e34d06be72bf0ed0266bbf 2023-11-18 20:55:10,155 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf, entries=1, sequenceid=24, filesize=5.0 K 2023-11-18 20:55:10,156 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for dbb912a5b612e2ba3e6bd669ef8c1b88 in 1648ms, sequenceid=24, compaction requested=true 2023-11-18 20:55:10,156 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:10,156 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-18 20:55:10,156 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-18 20:55:10,158 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,158 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:10,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-18 20:55:10,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d1b3d54[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:10,160 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-18 20:55:10,160 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,161 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-18 20:55:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-18 20:55:10,161 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:10,161 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,161 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:10,163 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-18 20:55:10,164 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,164 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:10,164 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-18 20:55:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:10,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:10,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-18 20:55:10,166 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-18 20:55:10,166 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:10,166 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:10,166 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-18 20:55:10,166 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:10,168 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,168 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,168 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:10,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:10,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:10,168 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,170 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-18 20:55:10,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-18 20:55:10,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:10,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-18 20:55:10,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:10,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:10,172 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:10,172 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:10,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:10,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:10,173 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:10,273 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:10,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:10,274 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:10,274 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): f5b54a9ca2bc73b4fe66796d83446d01/family1 is initiating major compaction (all files) 2023-11-18 20:55:10,275 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:10,275 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:10,275 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of f5b54a9ca2bc73b4fe66796d83446d01/family1 in testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:10,275 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp, totalSize=26.7 K 2023-11-18 20:55:10,275 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 6a2f7f2b658e4bd4b723f24ef3c779a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899902 2023-11-18 20:55:10,276 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 33f5b54ae4454abf90c71f07938ddb2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:10,276 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 04267bf50252477b8b913b4bfc0820c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:10,277 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 6ac776fe4654458a9f29faa9387b687a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:10,277 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 883c1231c5b746cc8a55b3beb2306967, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:10,305 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): f5b54a9ca2bc73b4fe66796d83446d01#family1#compaction#108 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:10,714 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del 2023-11-18 20:55:10,714 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del 2023-11-18 20:55:11,529 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada7d2a067e445beb6250c77ec2377e6 2023-11-18 20:55:11,530 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/ada7d2a067e445beb6250c77ec2377e6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/ada7d2a067e445beb6250c77ec2377e6 2023-11-18 20:55:11,533 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada7d2a067e445beb6250c77ec2377e6 2023-11-18 20:55:11,534 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f5b54a9ca2bc73b4fe66796d83446d01/family1 of f5b54a9ca2bc73b4fe66796d83446d01 into ada7d2a067e445beb6250c77ec2377e6(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:11,535 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:11,535 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:11,535 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): f5b54a9ca2bc73b4fe66796d83446d01/family2 is initiating major compaction (all files) 2023-11-18 20:55:11,535 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:11,535 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:11,535 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of f5b54a9ca2bc73b4fe66796d83446d01/family2 in testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:11,535 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp, totalSize=25.4 K 2023-11-18 20:55:11,536 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 5ae044d6bda842b18b0d1216a5036734, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899902 2023-11-18 20:55:11,536 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8a64a7fd83324249894f6aa3b213f6e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:11,536 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1518794407964981831bd9adc2f53657, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:11,536 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting d930f04e4ae14f899fb94afd452e27f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:11,537 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting b5457327c452494fa393ac3798e1007d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:11,555 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): f5b54a9ca2bc73b4fe66796d83446d01#family2#compaction#109 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:11,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967] to archive 2023-11-18 20:55:11,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:11,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6a2f7f2b658e4bd4b723f24ef3c779a3 2023-11-18 20:55:11,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/33f5b54ae4454abf90c71f07938ddb2a 2023-11-18 20:55:11,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/04267bf50252477b8b913b4bfc0820c0 2023-11-18 20:55:11,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/6ac776fe4654458a9f29faa9387b687a 2023-11-18 20:55:11,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/883c1231c5b746cc8a55b3beb2306967 2023-11-18 20:55:11,571 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del 2023-11-18 20:55:11,571 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del 2023-11-18 20:55:11,584 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af2f9b4ecae54d99a92e31af66071654 2023-11-18 20:55:11,584 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/af2f9b4ecae54d99a92e31af66071654 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/af2f9b4ecae54d99a92e31af66071654 2023-11-18 20:55:11,587 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af2f9b4ecae54d99a92e31af66071654 2023-11-18 20:55:11,588 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f5b54a9ca2bc73b4fe66796d83446d01/family2 of f5b54a9ca2bc73b4fe66796d83446d01 into af2f9b4ecae54d99a92e31af66071654(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:11,588 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:11,589 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:11,589 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): a58f913bb6e2f707eed0b258698334cc/family1 is initiating major compaction (all files) 2023-11-18 20:55:11,589 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:11,589 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:11,590 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of a58f913bb6e2f707eed0b258698334cc/family1 in testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:11,590 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp, totalSize=26.7 K 2023-11-18 20:55:11,590 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting ac3176d95a744d28be12d8b1b1cbdbb9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899903 2023-11-18 20:55:11,591 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 219e1768d83d48cf869aaabe1178646d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:11,591 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting a8bbfed79a5948c3ba75d295cbf233d4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:11,591 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting a4be93f8cfd34f74a7c52b098339e735, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:11,592 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 3c26c2a29a2a42ef9775783d0229107a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:11,603 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): a58f913bb6e2f707eed0b258698334cc#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:11,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d] to archive 2023-11-18 20:55:11,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:11,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/5ae044d6bda842b18b0d1216a5036734 2023-11-18 20:55:11,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/8a64a7fd83324249894f6aa3b213f6e1 2023-11-18 20:55:11,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/1518794407964981831bd9adc2f53657 2023-11-18 20:55:11,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/d930f04e4ae14f899fb94afd452e27f9 2023-11-18 20:55:11,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/b5457327c452494fa393ac3798e1007d 2023-11-18 20:55:12,014 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del 2023-11-18 20:55:12,014 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del 2023-11-18 20:55:12,827 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b300acea1b354649ade325ff0238009c 2023-11-18 20:55:12,828 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/b300acea1b354649ade325ff0238009c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/b300acea1b354649ade325ff0238009c 2023-11-18 20:55:12,831 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b300acea1b354649ade325ff0238009c 2023-11-18 20:55:12,832 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a58f913bb6e2f707eed0b258698334cc/family1 of a58f913bb6e2f707eed0b258698334cc into b300acea1b354649ade325ff0238009c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:12,832 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:12,832 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:12,832 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): a58f913bb6e2f707eed0b258698334cc/family2 is initiating major compaction (all files) 2023-11-18 20:55:12,832 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:12,832 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:12,833 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of a58f913bb6e2f707eed0b258698334cc/family2 in testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:12,833 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp, totalSize=25.4 K 2023-11-18 20:55:12,833 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 16d5d74c5d9044e09e19bed4c5937ed2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899903 2023-11-18 20:55:12,833 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting e0f566f7ab7449989b34d278962aa502, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:12,833 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 9a5dc57c2342434e9165fe7626ef3719, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:12,834 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 5b9de12d7d134aa7a88f38fadd80f15c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:12,834 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 90782451725c4f408220bece667248f5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:12,844 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): a58f913bb6e2f707eed0b258698334cc#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:12,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a] to archive 2023-11-18 20:55:12,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:12,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/ac3176d95a744d28be12d8b1b1cbdbb9 2023-11-18 20:55:12,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/219e1768d83d48cf869aaabe1178646d 2023-11-18 20:55:12,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a8bbfed79a5948c3ba75d295cbf233d4 2023-11-18 20:55:12,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/a4be93f8cfd34f74a7c52b098339e735 2023-11-18 20:55:12,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/3c26c2a29a2a42ef9775783d0229107a 2023-11-18 20:55:13,251 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del 2023-11-18 20:55:13,251 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del 2023-11-18 20:55:14,065 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10174293b3d7492fbb9d8d55d436b884 2023-11-18 20:55:14,065 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/10174293b3d7492fbb9d8d55d436b884 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/10174293b3d7492fbb9d8d55d436b884 2023-11-18 20:55:14,069 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10174293b3d7492fbb9d8d55d436b884 2023-11-18 20:55:14,070 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a58f913bb6e2f707eed0b258698334cc/family2 of a58f913bb6e2f707eed0b258698334cc into 10174293b3d7492fbb9d8d55d436b884(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:14,070 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:14,070 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:14,070 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): dbb912a5b612e2ba3e6bd669ef8c1b88/family1 is initiating major compaction (all files) 2023-11-18 20:55:14,070 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:14,070 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:14,070 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of dbb912a5b612e2ba3e6bd669ef8c1b88/family1 in testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:14,070 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp, totalSize=26.7 K 2023-11-18 20:55:14,071 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 658f7c0ee0e142afb53e2d53f902f7b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899904 2023-11-18 20:55:14,071 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 58213579abb24acbb44a28461e41d985, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:14,071 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting d1847298bac44a09bb878a1932a48777, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902696 2023-11-18 20:55:14,071 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting fe28ba4024c044f58442e9fd91b433d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:14,072 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 53f9ab3ccc33498387d2da9ff8a9b3a6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:14,081 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): dbb912a5b612e2ba3e6bd669ef8c1b88#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:14,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5] to archive 2023-11-18 20:55:14,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:14,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/16d5d74c5d9044e09e19bed4c5937ed2 2023-11-18 20:55:14,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/e0f566f7ab7449989b34d278962aa502 2023-11-18 20:55:14,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/9a5dc57c2342434e9165fe7626ef3719 2023-11-18 20:55:14,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/5b9de12d7d134aa7a88f38fadd80f15c 2023-11-18 20:55:14,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/90782451725c4f408220bece667248f5 2023-11-18 20:55:14,489 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del 2023-11-18 20:55:14,489 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del 2023-11-18 20:55:15,306 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 429bb2a380e0470dbc13d2edce40fa5b 2023-11-18 20:55:15,308 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/429bb2a380e0470dbc13d2edce40fa5b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/429bb2a380e0470dbc13d2edce40fa5b 2023-11-18 20:55:15,313 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 429bb2a380e0470dbc13d2edce40fa5b 2023-11-18 20:55:15,314 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dbb912a5b612e2ba3e6bd669ef8c1b88/family1 of dbb912a5b612e2ba3e6bd669ef8c1b88 into 429bb2a380e0470dbc13d2edce40fa5b(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:15,314 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:15,315 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:15,315 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): dbb912a5b612e2ba3e6bd669ef8c1b88/family2 is initiating major compaction (all files) 2023-11-18 20:55:15,315 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:15,315 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:15,315 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of dbb912a5b612e2ba3e6bd669ef8c1b88/family2 in testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:15,315 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp, totalSize=25.4 K 2023-11-18 20:55:15,315 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting e322ac8594494d4e878c88d4cc039a1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899904 2023-11-18 20:55:15,316 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8fbfb0eeddad422d85e64fa53b70d73b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:15,316 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 7e124fd968ca4e629f061f0a0be7af7f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902696 2023-11-18 20:55:15,316 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 84034ef749fc404c9df5abc9aa379f1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:15,317 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8e103199e9e34d06be72bf0ed0266bbf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-18 20:55:15,328 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): dbb912a5b612e2ba3e6bd669ef8c1b88#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:15,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6] to archive 2023-11-18 20:55:15,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:15,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/658f7c0ee0e142afb53e2d53f902f7b4 2023-11-18 20:55:15,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/58213579abb24acbb44a28461e41d985 2023-11-18 20:55:15,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/d1847298bac44a09bb878a1932a48777 2023-11-18 20:55:15,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/fe28ba4024c044f58442e9fd91b433d1 2023-11-18 20:55:15,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/53f9ab3ccc33498387d2da9ff8a9b3a6 2023-11-18 20:55:15,741 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del 2023-11-18 20:55:15,741 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del 2023-11-18 20:55:16,556 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a61fa99f8f204a4cb77ba49be3532fe6 2023-11-18 20:55:16,557 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/a61fa99f8f204a4cb77ba49be3532fe6 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/a61fa99f8f204a4cb77ba49be3532fe6 2023-11-18 20:55:16,561 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a61fa99f8f204a4cb77ba49be3532fe6 2023-11-18 20:55:16,562 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dbb912a5b612e2ba3e6bd669ef8c1b88/family2 of dbb912a5b612e2ba3e6bd669ef8c1b88 into a61fa99f8f204a4cb77ba49be3532fe6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:16,562 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:16,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf] to archive 2023-11-18 20:55:16,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:16,567 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:16,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/e322ac8594494d4e878c88d4cc039a1b 2023-11-18 20:55:16,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8fbfb0eeddad422d85e64fa53b70d73b 2023-11-18 20:55:16,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/7e124fd968ca4e629f061f0a0be7af7f 2023-11-18 20:55:16,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/84034ef749fc404c9df5abc9aa379f1e 2023-11-18 20:55:16,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/8e103199e9e34d06be72bf0ed0266bbf 2023-11-18 20:55:16,578 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:16,585 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:16,586 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:16,599 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:55:16,636 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-18 20:55:16,639 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del 2023-11-18 20:55:16,642 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del 2023-11-18 20:55:16,645 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del 2023-11-18 20:55:16,645 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:16,646 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(139): Connect 0x41164912 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:16,655 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30107c64, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:16,656 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:16,656 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:16,656 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:16,744 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459 2023-11-18 20:55:16,745 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:16,760 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:16,765 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:16,771 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:55:16,773 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:55:16,781 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/50dcb9597ec44cfea209f7e658830120 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-18 20:55:16,782 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/50dcb9597ec44cfea209f7e658830120}] 2023-11-18 20:55:16,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/50dcb9597ec44cfea209f7e658830120 for inclusion in a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-18 20:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 20:55:16,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:16,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/50dcb9597ec44cfea209f7e658830120 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__cdqcueci5af1qkvntphrkriej62jqh8sgs5dl6htc4pr0ibka8ub0c0an64k5nug/family1/50dcb9597ec44cfea209f7e658830120 2023-11-18 20:55:16,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__cdqcueci5af1qkvntphrkriej62jqh8sgs5dl6htc4pr0ibka8ub0c0an64k5nug/family1/50dcb9597ec44cfea209f7e658830120 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ 2023-11-18 20:55:16,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__cdqcueci5af1qkvntphrkriej62jqh8sgs5dl6htc4pr0ibka8ub0c0an64k5nug/family1/50dcb9597ec44cfea209f7e658830120 into a58f913bb6e2f707eed0b258698334cc/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ - updating store file list. 2023-11-18 20:55:16,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ into a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:16,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__cdqcueci5af1qkvntphrkriej62jqh8sgs5dl6htc4pr0ibka8ub0c0an64k5nug/family1/50dcb9597ec44cfea209f7e658830120 into a58f913bb6e2f707eed0b258698334cc/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_) 2023-11-18 20:55:16,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__cdqcueci5af1qkvntphrkriej62jqh8sgs5dl6htc4pr0ibka8ub0c0an64k5nug/family1/50dcb9597ec44cfea209f7e658830120 2023-11-18 20:55:16,798 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:16,798 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:16,799 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 2023-11-18 20:55:16,800 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f 2023-11-18 20:55:16,801 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e 2023-11-18 20:55:16,802 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c 2023-11-18 20:55:16,802 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:16,802 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 20:55:16,803 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:17,141 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70 2023-11-18 20:55:17,142 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308 2023-11-18 20:55:17,143 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:17,143 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:17,201 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/e523e972480e47edbd4bb7e4a5496cd1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-18 20:55:17,203 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/e523e972480e47edbd4bb7e4a5496cd1}] 2023-11-18 20:55:17,205 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/89a8ef735ad54ee6997ba68c0482fe5b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-18 20:55:17,205 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/89a8ef735ad54ee6997ba68c0482fe5b}] 2023-11-18 20:55:17,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/e523e972480e47edbd4bb7e4a5496cd1 for inclusion in dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:17,207 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/89a8ef735ad54ee6997ba68c0482fe5b for inclusion in f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:17,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-18 20:55:17,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 20:55:17,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/e523e972480e47edbd4bb7e4a5496cd1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__l5lsc6fgms9m4qr8tpbuo52ns0fp1tt1inmsp3if58daf0pfh99ah73dd2fp0n95/family1/e523e972480e47edbd4bb7e4a5496cd1 2023-11-18 20:55:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-18 20:55:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 20:55:17,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:17,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/89a8ef735ad54ee6997ba68c0482fe5b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__j4r8gudlp3khc01uivpjit43o0tln0enbjokqr9h652knlpav895282fnagq0dl1/family1/89a8ef735ad54ee6997ba68c0482fe5b 2023-11-18 20:55:17,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__j4r8gudlp3khc01uivpjit43o0tln0enbjokqr9h652knlpav895282fnagq0dl1/family1/89a8ef735ad54ee6997ba68c0482fe5b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ 2023-11-18 20:55:17,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__l5lsc6fgms9m4qr8tpbuo52ns0fp1tt1inmsp3if58daf0pfh99ah73dd2fp0n95/family1/e523e972480e47edbd4bb7e4a5496cd1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ 2023-11-18 20:55:17,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__l5lsc6fgms9m4qr8tpbuo52ns0fp1tt1inmsp3if58daf0pfh99ah73dd2fp0n95/family1/e523e972480e47edbd4bb7e4a5496cd1 into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ - updating store file list. 2023-11-18 20:55:17,222 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__j4r8gudlp3khc01uivpjit43o0tln0enbjokqr9h652knlpav895282fnagq0dl1/family1/89a8ef735ad54ee6997ba68c0482fe5b into f5b54a9ca2bc73b4fe66796d83446d01/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ - updating store file list. 2023-11-18 20:55:17,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:17,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__l5lsc6fgms9m4qr8tpbuo52ns0fp1tt1inmsp3if58daf0pfh99ah73dd2fp0n95/family1/e523e972480e47edbd4bb7e4a5496cd1 into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_) 2023-11-18 20:55:17,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__l5lsc6fgms9m4qr8tpbuo52ns0fp1tt1inmsp3if58daf0pfh99ah73dd2fp0n95/family1/e523e972480e47edbd4bb7e4a5496cd1 2023-11-18 20:55:17,227 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ into f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:17,227 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__j4r8gudlp3khc01uivpjit43o0tln0enbjokqr9h652knlpav895282fnagq0dl1/family1/89a8ef735ad54ee6997ba68c0482fe5b into f5b54a9ca2bc73b4fe66796d83446d01/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_) 2023-11-18 20:55:17,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__j4r8gudlp3khc01uivpjit43o0tln0enbjokqr9h652knlpav895282fnagq0dl1/family1/89a8ef735ad54ee6997ba68c0482fe5b 2023-11-18 20:55:17,230 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:17,230 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:17,232 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 2023-11-18 20:55:17,234 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 2023-11-18 20:55:17,234 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:17,235 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:17,236 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 2023-11-18 20:55:17,237 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 2023-11-18 20:55:17,238 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a 2023-11-18 20:55:17,238 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:17,238 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 20:55:17,238 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 2023-11-18 20:55:17,239 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:17,240 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e 2023-11-18 20:55:17,241 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 2023-11-18 20:55:17,241 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:17,241 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 20:55:17,241 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:17,241 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:17,241 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:17,241 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del] 2023-11-18 20:55:17,242 DEBUG [Listener at localhost/41997] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:17,243 DEBUG [Listener at localhost/41997] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023111846d70e770a9043d48ad81fd0331224be_del 2023-11-18 20:55:17,243 INFO [Listener at localhost/41997] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 20:55:17,243 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del] 2023-11-18 20:55:17,244 DEBUG [Listener at localhost/41997] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:17,245 DEBUG [Listener at localhost/41997] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118ed0cd6148dca4073a7c065a5ae17900a_del 2023-11-18 20:55:17,245 INFO [Listener at localhost/41997] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 20:55:17,245 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del] 2023-11-18 20:55:17,245 DEBUG [Listener at localhost/41997] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:17,246 DEBUG [Listener at localhost/41997] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311183cd6a16317b44ab4a8ad7915b01d0274_del 2023-11-18 20:55:17,246 INFO [Listener at localhost/41997] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-18 20:55:17,249 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:17,252 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:17,256 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:17,257 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:17,266 INFO [Listener at localhost/41997] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-18 20:55:17,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-18 20:55:17,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-18 20:55:17,270 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340917270"}]},"ts":"1700340917270"} 2023-11-18 20:55:17,272 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-18 20:55:17,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 20:55:17,274 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-18 20:55:17,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, UNASSIGN}] 2023-11-18 20:55:17,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, UNASSIGN 2023-11-18 20:55:17,277 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, UNASSIGN 2023-11-18 20:55:17,277 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, UNASSIGN 2023-11-18 20:55:17,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:17,278 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340917278"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340917278"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340917278"}]},"ts":"1700340917278"} 2023-11-18 20:55:17,279 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:17,279 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340917279"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340917279"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340917279"}]},"ts":"1700340917279"} 2023-11-18 20:55:17,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:17,280 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:17,280 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340917280"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340917280"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340917280"}]},"ts":"1700340917280"} 2023-11-18 20:55:17,281 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:17,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:17,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 20:55:17,434 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:17,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:17,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbb912a5b612e2ba3e6bd669ef8c1b88, disabling compactions & flushes 2023-11-18 20:55:17,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:17,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:17,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. after waiting 0 ms 2023-11-18 20:55:17,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:17,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 20:55:17,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:17,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:17,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:17,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:17,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a58f913bb6e2f707eed0b258698334cc, disabling compactions & flushes 2023-11-18 20:55:17,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:17,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:17,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. after waiting 0 ms 2023-11-18 20:55:17,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:17,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=CLOSED 2023-11-18 20:55:17,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340917442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340917442"}]},"ts":"1700340917442"} 2023-11-18 20:55:17,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=91 2023-11-18 20:55:17,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897 in 163 msec 2023-11-18 20:55:17,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, UNASSIGN in 170 msec 2023-11-18 20:55:17,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 20:55:17,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:17,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:17,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:17,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:17,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f5b54a9ca2bc73b4fe66796d83446d01, disabling compactions & flushes 2023-11-18 20:55:17,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:17,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:17,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. after waiting 0 ms 2023-11-18 20:55:17,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:17,454 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=CLOSED 2023-11-18 20:55:17,454 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340917454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340917454"}]},"ts":"1700340917454"} 2023-11-18 20:55:17,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=90 2023-11-18 20:55:17,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897 in 174 msec 2023-11-18 20:55:17,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-18 20:55:17,459 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, UNASSIGN in 183 msec 2023-11-18 20:55:17,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:17,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:17,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:17,461 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=CLOSED 2023-11-18 20:55:17,461 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340917461"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340917461"}]},"ts":"1700340917461"} 2023-11-18 20:55:17,463 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-18 20:55:17,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897 in 181 msec 2023-11-18 20:55:17,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-11-18 20:55:17,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, UNASSIGN in 189 msec 2023-11-18 20:55:17,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340917465"}]},"ts":"1700340917465"} 2023-11-18 20:55:17,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-18 20:55:17,470 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-18 20:55:17,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 203 msec 2023-11-18 20:55:17,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-18 20:55:17,576 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-18 20:55:17,588 INFO [Listener at localhost/41997] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:17,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1700340917589 (current time:1700340917589). 2023-11-18 20:55:17,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-18 20:55:17,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] zookeeper.ReadOnlyZKClient(139): Connect 0x59b5c100 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:17,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d8880ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:17,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:17,599 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:17,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b5c100 to 127.0.0.1:55479 2023-11-18 20:55:17,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:17,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-18 20:55:17,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:17,603 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot, current working dir path: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700340906297-1700340917588 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-18 20:55:17,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:17,606 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:17,606 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1700341517606 2023-11-18 20:55:17,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:17,606 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1700340906297-1700340917588 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-18 20:55:17,607 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:17,607 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-18 20:55:17,707 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:17,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:17,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:17,708 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-18 20:55:17,908 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:17,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:17,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:17,910 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-18 20:55:18,015 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 20:55:18,017 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-18 20:55:18,025 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/b300acea1b354649ade325ff0238009c] hfiles 2023-11-18 20:55:18,025 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ 2023-11-18 20:55:18,025 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/b300acea1b354649ade325ff0238009c 2023-11-18 20:55:18,026 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/ada7d2a067e445beb6250c77ec2377e6] hfiles 2023-11-18 20:55:18,026 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ 2023-11-18 20:55:18,026 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/ada7d2a067e445beb6250c77ec2377e6 2023-11-18 20:55:18,026 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/429bb2a380e0470dbc13d2edce40fa5b] hfiles 2023-11-18 20:55:18,026 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/10174293b3d7492fbb9d8d55d436b884] hfiles 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/10174293b3d7492fbb9d8d55d436b884 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70] hfiles 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70 2023-11-18 20:55:18,027 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/429bb2a380e0470dbc13d2edce40fa5b 2023-11-18 20:55:18,028 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/af2f9b4ecae54d99a92e31af66071654] hfiles 2023-11-18 20:55:18,028 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/af2f9b4ecae54d99a92e31af66071654 2023-11-18 20:55:18,029 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/a61fa99f8f204a4cb77ba49be3532fe6] hfiles 2023-11-18 20:55:18,029 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/a61fa99f8f204a4cb77ba49be3532fe6 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1] hfiles 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311188ce979782f6f46c29ee56f9f862769b9 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9ff7d6b691948b98ade649f3167e7bb 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118d0b1bc310eb34ac591c55cdcb8a3dd97 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231118eb77b819a4c840f49c8cd5c5e2d73639 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311182b243111e63a439fa9ab82bba5167eed 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311183e48f7e4d529401ebb964e09d9fb500f 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118b7b159b34def454a95c618c376d44dcd 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231118e64885a387d54da589e01dc2e34b7433 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311181c778ab605944c26b989561b12c1c481 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311187108788db8374cb7ad07081ebac3f1b8 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111897a4e8eecfdf4a55947767745d2a620d 2023-11-18 20:55:18,037 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231118b18b4e1766124bc1b4a1a111b1603bb1 2023-11-18 20:55:18,210 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:18,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:18,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-18 20:55:18,212 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-18 20:55:18,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-18 20:55:18,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:18,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:18,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700340906297-1700340917588 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:18,496 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1700340906297-1700340917588 of table testCompactionWithHFileLink completed 2023-11-18 20:55:18,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:18,497 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:18,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1700340906297-1700340917588 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1700340917606Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1700340918015 (+409 ms)Consolidate snapshot: hbase-failsafe-snaptb-1700340906297-1700340917588 at 1700340918457 (+442 ms)Loading Region manifests for hbase-failsafe-snaptb-1700340906297-1700340917588 at 1700340918457Writing data manifest for hbase-failsafe-snaptb-1700340906297-1700340917588 at 1700340918462 (+5 ms)Verifying snapshot: hbase-failsafe-snaptb-1700340906297-1700340917588 at 1700340918476 (+14 ms)Snapshot hbase-failsafe-snaptb-1700340906297-1700340917588 of table testCompactionWithHFileLink completed at 1700340918496 (+20 ms) 2023-11-18 20:55:18,498 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-18 20:55:18,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 894 msec 2023-11-18 20:55:18,712 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-18 20:55:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-18 20:55:18,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1700340906297-1700340917588 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-18 20:55:18,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700340906297" table: "testCompactionWithHFileLink" creation_time: 1700340906308 type: FLUSH version: 2 ttl: 0 ) 2023-11-18 20:55:18,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1700340906297 as table=testCompactionWithHFileLink 2023-11-18 20:55:18,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 20:55:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 20:55:19,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 20:55:19,167 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-18 20:55:19,168 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-18 20:55:19,168 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-18 20:55:19,169 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-18 20:55:19,173 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1700340906297" table: "testCompactionWithHFileLink" creation_time: 1700340906308 type: FLUSH version: 2 ttl: 0 2023-11-18 20:55:19,174 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink 2023-11-18 20:55:19,180 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-18 20:55:19,183 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311185aa3b7e82bf647b8b837d4cb0f67c459 2023-11-18 20:55:19,185 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118bfba3d1ee531453db4c678af547a4308 2023-11-18 20:55:19,186 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311186a8ca438eab64501b54f5219420eab70 2023-11-18 20:55:19,186 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,190 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,193 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,196 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,200 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,204 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,207 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,219 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,222 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,226 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,229 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,233 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 of snapshot=snaptb-1700340906297 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-18 20:55:19,238 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111812f0090429934c67a92acc256fb4d910_del 2023-11-18 20:55:19,239 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311181c5f1d85e4e54e95a2c4fcb39a8d100c_del 2023-11-18 20:55:19,240 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023111830116c88c92b4ac9b9f25c72144df512_del 2023-11-18 20:55:19,240 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,240 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,240 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,244 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/0ced47f821b1445eb0b53199643db44f_SeqId_29_ 2023-11-18 20:55:19,244 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/3ccb131c073649d9b02a1178a6a8409b_SeqId_29_ 2023-11-18 20:55:19,244 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a4e7fc415603427ea0ec2fbd7b6d2fa8_SeqId_29_ 2023-11-18 20:55:19,245 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/b300acea1b354649ade325ff0238009c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/b300acea1b354649ade325ff0238009c 2023-11-18 20:55:19,245 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ac3176d95a744d28be12d8b1b1cbdbb9 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,246 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/429bb2a380e0470dbc13d2edce40fa5b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/429bb2a380e0470dbc13d2edce40fa5b 2023-11-18 20:55:19,246 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 658f7c0ee0e142afb53e2d53f902f7b4 of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,246 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/ada7d2a067e445beb6250c77ec2377e6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/ada7d2a067e445beb6250c77ec2377e6 2023-11-18 20:55:19,246 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6a2f7f2b658e4bd4b723f24ef3c779a3 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,252 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 58213579abb24acbb44a28461e41d985 of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,252 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 219e1768d83d48cf869aaabe1178646d of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,253 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 33f5b54ae4454abf90c71f07938ddb2a of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,259 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d1847298bac44a09bb878a1932a48777 of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,268 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8bbfed79a5948c3ba75d295cbf233d4 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,269 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 04267bf50252477b8b913b4bfc0820c0 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,277 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fe28ba4024c044f58442e9fd91b433d1 of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,279 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a4be93f8cfd34f74a7c52b098339e735 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,279 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ac776fe4654458a9f29faa9387b687a of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,284 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/10174293b3d7492fbb9d8d55d436b884 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/10174293b3d7492fbb9d8d55d436b884 2023-11-18 20:55:19,285 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 16d5d74c5d9044e09e19bed4c5937ed2 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,285 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/a61fa99f8f204a4cb77ba49be3532fe6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/a61fa99f8f204a4cb77ba49be3532fe6 2023-11-18 20:55:19,285 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e322ac8594494d4e878c88d4cc039a1b of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,285 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/af2f9b4ecae54d99a92e31af66071654 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/af2f9b4ecae54d99a92e31af66071654 2023-11-18 20:55:19,285 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5ae044d6bda842b18b0d1216a5036734 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,290 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e0f566f7ab7449989b34d278962aa502 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,296 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8a64a7fd83324249894f6aa3b213f6e1 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,297 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8fbfb0eeddad422d85e64fa53b70d73b of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,298 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9a5dc57c2342434e9165fe7626ef3719 of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,305 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1518794407964981831bd9adc2f53657 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,306 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7e124fd968ca4e629f061f0a0be7af7f of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,306 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5b9de12d7d134aa7a88f38fadd80f15c of snapshot=snaptb-1700340906297 to region=a58f913bb6e2f707eed0b258698334cc table=testCompactionWithHFileLink 2023-11-18 20:55:19,309 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d930f04e4ae14f899fb94afd452e27f9 of snapshot=snaptb-1700340906297 to region=f5b54a9ca2bc73b4fe66796d83446d01 table=testCompactionWithHFileLink 2023-11-18 20:55:19,310 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 84034ef749fc404c9df5abc9aa379f1e of snapshot=snaptb-1700340906297 to region=dbb912a5b612e2ba3e6bd669ef8c1b88 table=testCompactionWithHFileLink 2023-11-18 20:55:19,313 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1700340906297" table: "testCompactionWithHFileLink" creation_time: 1700340906308 type: FLUSH version: 2 ttl: 0 2023-11-18 20:55:19,315 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700340919314"}]},"ts":"9223372036854775807"} 2023-11-18 20:55:19,315 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700340919314"}]},"ts":"9223372036854775807"} 2023-11-18 20:55:19,315 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1700340919314"}]},"ts":"9223372036854775807"} 2023-11-18 20:55:19,316 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-18 20:55:19,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a58f913bb6e2f707eed0b258698334cc, NAME => 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => dbb912a5b612e2ba3e6bd669ef8c1b88, NAME => 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f5b54a9ca2bc73b4fe66796d83446d01, NAME => 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.', STARTKEY => '', ENDKEY => '1'}] 2023-11-18 20:55:19,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340919315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340919315"}]},"ts":"1700340919315"} 2023-11-18 20:55:19,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340919315"}]},"ts":"1700340919315"} 2023-11-18 20:55:19,317 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340919315"}]},"ts":"1700340919315"} 2023-11-18 20:55:19,319 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 20:55:19,319 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-18 20:55:19,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => a58f913bb6e2f707eed0b258698334cc, NAME => 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => dbb912a5b612e2ba3e6bd669ef8c1b88, NAME => 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => f5b54a9ca2bc73b4fe66796d83446d01, NAME => 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.', STARTKEY => '', ENDKEY => '1'}] 2023-11-18 20:55:19,319 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1700340906297 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-18 20:55:19,321 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1700340906297" table: "testCompactionWithHFileLink" creation_time: 1700340906308 type: FLUSH version: 2 ttl: 0 ) in 575 msec 2023-11-18 20:55:19,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-18 20:55:19,360 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-18 20:55:19,360 INFO [Listener at localhost/41997] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:19,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1700340906297-1700340917588" 2023-11-18 20:55:19,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1700340906297-1700340917588 2023-11-18 20:55:19,369 INFO [Listener at localhost/41997] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-18 20:55:19,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-18 20:55:19,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-18 20:55:19,380 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-18 20:55:19,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 20:55:19,381 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340919381"}]},"ts":"1700340919381"} 2023-11-18 20:55:19,382 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-18 20:55:19,384 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-18 20:55:19,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN}] 2023-11-18 20:55:19,385 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN 2023-11-18 20:55:19,386 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN 2023-11-18 20:55:19,386 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN 2023-11-18 20:55:19,386 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 20:55:19,386 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 20:55:19,386 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-18 20:55:19,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 20:55:19,538 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,538 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,538 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,538 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340919538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340919538"}]},"ts":"1700340919538"} 2023-11-18 20:55:19,538 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340919538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340919538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340919538"}]},"ts":"1700340919538"} 2023-11-18 20:55:19,538 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919538"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340919538"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340919538"}]},"ts":"1700340919538"} 2023-11-18 20:55:19,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:19,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:19,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:19,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 20:55:19,692 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:19,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbb912a5b612e2ba3e6bd669ef8c1b88, NAME => 'testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 20:55:19,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:19,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,696 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,697 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:19,697 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:19,697 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb912a5b612e2ba3e6bd669ef8c1b88 columnFamilyName family1 2023-11-18 20:55:19,706 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985 2023-11-18 20:55:19,711 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4 2023-11-18 20:55:19,715 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777 2023-11-18 20:55:19,720 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1 2023-11-18 20:55:19,720 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(310): Store=dbb912a5b612e2ba3e6bd669ef8c1b88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,720 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,721 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2 2023-11-18 20:55:19,721 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2 2023-11-18 20:55:19,721 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbb912a5b612e2ba3e6bd669ef8c1b88 columnFamilyName family2 2023-11-18 20:55:19,728 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f 2023-11-18 20:55:19,733 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e 2023-11-18 20:55:19,741 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b 2023-11-18 20:55:19,746 DEBUG [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b 2023-11-18 20:55:19,746 INFO [StoreOpener-dbb912a5b612e2ba3e6bd669ef8c1b88-1] regionserver.HStore(310): Store=dbb912a5b612e2ba3e6bd669ef8c1b88/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:19,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:55:19,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbb912a5b612e2ba3e6bd669ef8c1b88; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67784611, jitterRate=0.010069414973258972}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:19,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:19,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., pid=103, masterSystemTime=1700340919691 2023-11-18 20:55:19,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:19,754 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:19,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 20:55:19,754 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:19,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:19,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a58f913bb6e2f707eed0b258698334cc, NAME => 'testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 20:55:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:19,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=dbb912a5b612e2ba3e6bd669ef8c1b88, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340919757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340919757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340919757"}]},"ts":"1700340919757"} 2023-11-18 20:55:19,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-11-18 20:55:19,761 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure dbb912a5b612e2ba3e6bd669ef8c1b88, server=jenkins-hbase4.apache.org,32871,1700340802897 in 218 msec 2023-11-18 20:55:19,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dbb912a5b612e2ba3e6bd669ef8c1b88, ASSIGN in 377 msec 2023-11-18 20:55:19,767 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,768 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:19,768 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1912): dbb912a5b612e2ba3e6bd669ef8c1b88/family2 is initiating minor compaction (all files) 2023-11-18 20:55:19,768 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dbb912a5b612e2ba3e6bd669ef8c1b88/family2 in testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:19,768 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp, totalSize=20.4 K 2023-11-18 20:55:19,768 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:19,769 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1912): dbb912a5b612e2ba3e6bd669ef8c1b88/family1 is initiating minor compaction (all files) 2023-11-18 20:55:19,769 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2259): Starting compaction of dbb912a5b612e2ba3e6bd669ef8c1b88/family1 in testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:55:19,769 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp, totalSize=21.6 K 2023-11-18 20:55:19,769 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:19,769 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:19,770 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899904 2023-11-18 20:55:19,770 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a58f913bb6e2f707eed0b258698334cc columnFamilyName family1 2023-11-18 20:55:19,770 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:19,771 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902696 2023-11-18 20:55:19,772 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:19,782 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899904 2023-11-18 20:55:19,783 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:19,785 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902696 2023-11-18 20:55:19,786 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:19,808 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d 2023-11-18 20:55:19,839 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735 2023-11-18 20:55:19,841 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] throttle.PressureAwareThroughputController(145): dbb912a5b612e2ba3e6bd669ef8c1b88#family1#compaction#114 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:19,849 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4 2023-11-18 20:55:19,864 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): dbb912a5b612e2ba3e6bd669ef8c1b88#family2#compaction#115 average throughput is 0.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:19,865 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9 2023-11-18 20:55:19,869 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(310): Store=a58f913bb6e2f707eed0b258698334cc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,869 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,870 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2 2023-11-18 20:55:19,871 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2 2023-11-18 20:55:19,871 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a58f913bb6e2f707eed0b258698334cc columnFamilyName family2 2023-11-18 20:55:19,887 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2 2023-11-18 20:55:19,894 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c 2023-11-18 20:55:19,898 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719 2023-11-18 20:55:19,903 DEBUG [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502 2023-11-18 20:55:19,903 INFO [StoreOpener-a58f913bb6e2f707eed0b258698334cc-1] regionserver.HStore(310): Store=a58f913bb6e2f707eed0b258698334cc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:19,907 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:55:19,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a58f913bb6e2f707eed0b258698334cc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74043322, jitterRate=0.10333147644996643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:19,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:19,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., pid=102, masterSystemTime=1700340919691 2023-11-18 20:55:19,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 20:55:19,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-18 20:55:19,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:19,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:19,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:19,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f5b54a9ca2bc73b4fe66796d83446d01, NAME => 'testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 20:55:19,910 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=a58f913bb6e2f707eed0b258698334cc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,910 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340919910"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340919910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340919910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340919910"}]},"ts":"1700340919910"} 2023-11-18 20:55:19,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:19,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,912 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,913 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:19,913 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:19,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-18 20:55:19,913 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5b54a9ca2bc73b4fe66796d83446d01 columnFamilyName family1 2023-11-18 20:55:19,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure a58f913bb6e2f707eed0b258698334cc, server=jenkins-hbase4.apache.org,32871,1700340802897 in 371 msec 2023-11-18 20:55:19,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=a58f913bb6e2f707eed0b258698334cc, ASSIGN in 529 msec 2023-11-18 20:55:19,922 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0 2023-11-18 20:55:19,932 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a 2023-11-18 20:55:19,938 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3 2023-11-18 20:55:19,944 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a 2023-11-18 20:55:19,945 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(310): Store=f5b54a9ca2bc73b4fe66796d83446d01/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,945 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,946 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2 2023-11-18 20:55:19,946 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2 2023-11-18 20:55:19,946 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f5b54a9ca2bc73b4fe66796d83446d01 columnFamilyName family2 2023-11-18 20:55:19,956 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657 2023-11-18 20:55:19,961 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734 2023-11-18 20:55:19,967 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1 2023-11-18 20:55:19,973 DEBUG [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(539): loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9 2023-11-18 20:55:19,973 INFO [StoreOpener-f5b54a9ca2bc73b4fe66796d83446d01-1] regionserver.HStore(310): Store=f5b54a9ca2bc73b4fe66796d83446d01/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:19,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:19,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:55:19,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f5b54a9ca2bc73b4fe66796d83446d01; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71408317, jitterRate=0.06406684219837189}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:19,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:19,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., pid=101, masterSystemTime=1700340919691 2023-11-18 20:55:19,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-18 20:55:19,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-18 20:55:19,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:19,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:19,981 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=f5b54a9ca2bc73b4fe66796d83446d01, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:19,981 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1700340919981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340919981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340919981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340919981"}]},"ts":"1700340919981"} 2023-11-18 20:55:19,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 20:55:19,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-18 20:55:19,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure f5b54a9ca2bc73b4fe66796d83446d01, server=jenkins-hbase4.apache.org,32871,1700340802897 in 442 msec 2023-11-18 20:55:19,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-11-18 20:55:19,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f5b54a9ca2bc73b4fe66796d83446d01, ASSIGN in 600 msec 2023-11-18 20:55:19,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340919986"}]},"ts":"1700340919986"} 2023-11-18 20:55:19,987 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-18 20:55:19,989 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-18 20:55:19,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 616 msec 2023-11-18 20:55:20,282 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family1/c5f7a02d95474666b559c7e5c5a9d7a4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/c5f7a02d95474666b559c7e5c5a9d7a4 2023-11-18 20:55:20,286 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-18 20:55:20,287 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in dbb912a5b612e2ba3e6bd669ef8c1b88/family1 of dbb912a5b612e2ba3e6bd669ef8c1b88 into c5f7a02d95474666b559c7e5c5a9d7a4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:20,287 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:20,287 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., storeName=dbb912a5b612e2ba3e6bd669ef8c1b88/family1, priority=12, startTime=1700340919753; duration=0sec 2023-11-18 20:55:20,287 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-18 20:55:20,288 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:20,292 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:20,292 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1912): a58f913bb6e2f707eed0b258698334cc/family1 is initiating minor compaction (all files) 2023-11-18 20:55:20,292 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a58f913bb6e2f707eed0b258698334cc/family1 in testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:20,292 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp, totalSize=21.6 K 2023-11-18 20:55:20,293 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899903 2023-11-18 20:55:20,294 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:20,294 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:20,295 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:20,308 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] throttle.PressureAwareThroughputController(145): a58f913bb6e2f707eed0b258698334cc#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:20,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1] to archive 2023-11-18 20:55:20,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:20,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-658f7c0ee0e142afb53e2d53f902f7b4 2023-11-18 20:55:20,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-58213579abb24acbb44a28461e41d985 2023-11-18 20:55:20,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-d1847298bac44a09bb878a1932a48777 2023-11-18 20:55:20,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-fe28ba4024c044f58442e9fd91b433d1 2023-11-18 20:55:20,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-18 20:55:20,485 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-18 20:55:20,497 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:20,506 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:20,511 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:20,512 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:20,518 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:55:20,533 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-18 20:55:20,533 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:20,534 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(139): Connect 0x4c777ddb to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:20,542 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ba97297, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:20,542 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:20,542 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:20,542 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:20,726 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family1/6c158ec044f54969bca5dce53fdf89a5 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/6c158ec044f54969bca5dce53fdf89a5 2023-11-18 20:55:20,731 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a58f913bb6e2f707eed0b258698334cc/family1 of a58f913bb6e2f707eed0b258698334cc into 6c158ec044f54969bca5dce53fdf89a5(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:20,731 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:20,731 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., storeName=a58f913bb6e2f707eed0b258698334cc/family1, priority=12, startTime=1700340919908; duration=0sec 2023-11-18 20:55:20,731 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-18 20:55:20,732 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:20,734 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:20,734 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1912): f5b54a9ca2bc73b4fe66796d83446d01/family2 is initiating minor compaction (all files) 2023-11-18 20:55:20,735 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f5b54a9ca2bc73b4fe66796d83446d01/family2 in testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:20,735 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp, totalSize=20.4 K 2023-11-18 20:55:20,735 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899902 2023-11-18 20:55:20,736 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:20,737 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:20,737 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:20,756 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] throttle.PressureAwareThroughputController(145): f5b54a9ca2bc73b4fe66796d83446d01#family2#compaction#117 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:20,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735] to archive 2023-11-18 20:55:20,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:20,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-ac3176d95a744d28be12d8b1b1cbdbb9 2023-11-18 20:55:20,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-219e1768d83d48cf869aaabe1178646d 2023-11-18 20:55:20,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a8bbfed79a5948c3ba75d295cbf233d4 2023-11-18 20:55:20,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-a4be93f8cfd34f74a7c52b098339e735 2023-11-18 20:55:21,101 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/.tmp/family2/99c49858b313456db53c8b0d566bfa58 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/99c49858b313456db53c8b0d566bfa58 2023-11-18 20:55:21,106 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in dbb912a5b612e2ba3e6bd669ef8c1b88/family2 of dbb912a5b612e2ba3e6bd669ef8c1b88 into 99c49858b313456db53c8b0d566bfa58(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:21,106 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:21,106 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., storeName=dbb912a5b612e2ba3e6bd669ef8c1b88/family2, priority=12, startTime=1700340919754; duration=1sec 2023-11-18 20:55:21,106 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-18 20:55:21,106 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:21,108 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:21,108 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1912): f5b54a9ca2bc73b4fe66796d83446d01/family1 is initiating minor compaction (all files) 2023-11-18 20:55:21,108 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f5b54a9ca2bc73b4fe66796d83446d01/family1 in testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:55:21,108 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp, totalSize=21.6 K 2023-11-18 20:55:21,108 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899902 2023-11-18 20:55:21,109 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:21,109 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:21,110 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:21,121 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): f5b54a9ca2bc73b4fe66796d83446d01#family1#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:21,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e] to archive 2023-11-18 20:55:21,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-e322ac8594494d4e878c88d4cc039a1b 2023-11-18 20:55:21,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-8fbfb0eeddad422d85e64fa53b70d73b 2023-11-18 20:55:21,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-7e124fd968ca4e629f061f0a0be7af7f 2023-11-18 20:55:21,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family2/testCompactionWithHFileLink=dbb912a5b612e2ba3e6bd669ef8c1b88-84034ef749fc404c9df5abc9aa379f1e 2023-11-18 20:55:21,435 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118f9a7c5d3f92d49c3a42e4d566b8d4db3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231118f9a7c5d3f92d49c3a42e4d566b8d4db3 2023-11-18 20:55:21,435 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118c31b0e3bf89f48e5bf7be3c596d86f9e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231118c31b0e3bf89f48e5bf7be3c596d86f9e 2023-11-18 20:55:21,435 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118f016fbbf75e14e56b11b73ef242597e0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231118f016fbbf75e14e56b11b73ef242597e0 2023-11-18 20:55:21,436 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,436 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,436 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,451 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:21,456 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:21,462 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:55:21,466 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48130, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:55:21,494 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/2c55b18d1e1540d08dbc57c6050fa39f first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-18 20:55:21,495 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/540dde061b964f5e88c30c8523dbc893 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-18 20:55:21,495 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/2c55b18d1e1540d08dbc57c6050fa39f}] 2023-11-18 20:55:21,496 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/540dde061b964f5e88c30c8523dbc893}] 2023-11-18 20:55:21,496 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/447109d0a265449b9b14b0e6e7dcd091 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-18 20:55:21,498 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=32 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/447109d0a265449b9b14b0e6e7dcd091}] 2023-11-18 20:55:21,503 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/2c55b18d1e1540d08dbc57c6050fa39f for inclusion in a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:21,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/540dde061b964f5e88c30c8523dbc893 for inclusion in dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:21,503 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/447109d0a265449b9b14b0e6e7dcd091 for inclusion in f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:21,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-18 20:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 20:55:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118/family1/2c55b18d1e1540d08dbc57c6050fa39f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__sae1s47umatngknibsl3fojj04oh4bgligefb0pb9g5mvanrmrj5asdp8s4fr0nb/family1/2c55b18d1e1540d08dbc57c6050fa39f 2023-11-18 20:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118/family1/540dde061b964f5e88c30c8523dbc893 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__k1nf13sdlrjknemuo8i60nvj4o660ff31vfq0kmigclde9cgnebmra05vvr2mc9c/family1/540dde061b964f5e88c30c8523dbc893 2023-11-18 20:55:21,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118/family1/447109d0a265449b9b14b0e6e7dcd091 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__jda5grgpl0ma20ls1q4endtg2lf7v3hsi9se565kn1jktfhfq6rs0iv83naulcqg/family1/447109d0a265449b9b14b0e6e7dcd091 2023-11-18 20:55:21,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__sae1s47umatngknibsl3fojj04oh4bgligefb0pb9g5mvanrmrj5asdp8s4fr0nb/family1/2c55b18d1e1540d08dbc57c6050fa39f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/946f2f4bedfe45d1bf2c8eb0a4754a64_SeqId_35_ 2023-11-18 20:55:21,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__jda5grgpl0ma20ls1q4endtg2lf7v3hsi9se565kn1jktfhfq6rs0iv83naulcqg/family1/447109d0a265449b9b14b0e6e7dcd091 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/4f08ef131e094286ba0faf7f5c331bdc_SeqId_34_ 2023-11-18 20:55:21,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__k1nf13sdlrjknemuo8i60nvj4o660ff31vfq0kmigclde9cgnebmra05vvr2mc9c/family1/540dde061b964f5e88c30c8523dbc893 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/ea5a7c5edbaf4f6ea71f0e0ee72adfaa_SeqId_36_ 2023-11-18 20:55:21,511 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__sae1s47umatngknibsl3fojj04oh4bgligefb0pb9g5mvanrmrj5asdp8s4fr0nb/family1/2c55b18d1e1540d08dbc57c6050fa39f into a58f913bb6e2f707eed0b258698334cc/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/946f2f4bedfe45d1bf2c8eb0a4754a64_SeqId_35_ - updating store file list. 2023-11-18 20:55:21,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__jda5grgpl0ma20ls1q4endtg2lf7v3hsi9se565kn1jktfhfq6rs0iv83naulcqg/family1/447109d0a265449b9b14b0e6e7dcd091 into f5b54a9ca2bc73b4fe66796d83446d01/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/4f08ef131e094286ba0faf7f5c331bdc_SeqId_34_ - updating store file list. 2023-11-18 20:55:21,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__k1nf13sdlrjknemuo8i60nvj4o660ff31vfq0kmigclde9cgnebmra05vvr2mc9c/family1/540dde061b964f5e88c30c8523dbc893 into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/ea5a7c5edbaf4f6ea71f0e0ee72adfaa_SeqId_36_ - updating store file list. 2023-11-18 20:55:21,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/4f08ef131e094286ba0faf7f5c331bdc_SeqId_34_ into f5b54a9ca2bc73b4fe66796d83446d01/family1 2023-11-18 20:55:21,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/ea5a7c5edbaf4f6ea71f0e0ee72adfaa_SeqId_36_ into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 2023-11-18 20:55:21,515 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/946f2f4bedfe45d1bf2c8eb0a4754a64_SeqId_35_ into a58f913bb6e2f707eed0b258698334cc/family1 2023-11-18 20:55:21,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__k1nf13sdlrjknemuo8i60nvj4o660ff31vfq0kmigclde9cgnebmra05vvr2mc9c/family1/540dde061b964f5e88c30c8523dbc893 into dbb912a5b612e2ba3e6bd669ef8c1b88/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/family1/ea5a7c5edbaf4f6ea71f0e0ee72adfaa_SeqId_36_) 2023-11-18 20:55:21,515 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__jda5grgpl0ma20ls1q4endtg2lf7v3hsi9se565kn1jktfhfq6rs0iv83naulcqg/family1/447109d0a265449b9b14b0e6e7dcd091 into f5b54a9ca2bc73b4fe66796d83446d01/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/4f08ef131e094286ba0faf7f5c331bdc_SeqId_34_) 2023-11-18 20:55:21,516 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__sae1s47umatngknibsl3fojj04oh4bgligefb0pb9g5mvanrmrj5asdp8s4fr0nb/family1/2c55b18d1e1540d08dbc57c6050fa39f into a58f913bb6e2f707eed0b258698334cc/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family1/946f2f4bedfe45d1bf2c8eb0a4754a64_SeqId_35_) 2023-11-18 20:55:21,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__k1nf13sdlrjknemuo8i60nvj4o660ff31vfq0kmigclde9cgnebmra05vvr2mc9c/family1/540dde061b964f5e88c30c8523dbc893 2023-11-18 20:55:21,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__jda5grgpl0ma20ls1q4endtg2lf7v3hsi9se565kn1jktfhfq6rs0iv83naulcqg/family1/447109d0a265449b9b14b0e6e7dcd091 2023-11-18 20:55:21,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testCompactionWithHFileLink__sae1s47umatngknibsl3fojj04oh4bgligefb0pb9g5mvanrmrj5asdp8s4fr0nb/family1/2c55b18d1e1540d08dbc57c6050fa39f 2023-11-18 20:55:21,518 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,518 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,518 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,520 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,520 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,520 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,522 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118af1030cb3cc94d458bb262168314e241 2023-11-18 20:55:21,522 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311180b85c28d1a654780b3cef3d8446b7016 2023-11-18 20:55:21,522 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023111821ece1be676a49e6823429c0c06244a4 2023-11-18 20:55:21,523 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118cb2334020fdb4e49bde2f032d0b6c9c7 2023-11-18 20:55:21,523 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231118768fd1fc3d0b4c479121f08688d9df4f 2023-11-18 20:55:21,523 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311187b00e66c7bc04b10806bb80306f5b0f4 2023-11-18 20:55:21,524 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111896aa66b4379b4d6c8084c29f8910df4e 2023-11-18 20:55:21,524 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118da90c0dc60cd43289f5765875d0955d6 2023-11-18 20:55:21,525 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118a8ca629462af459e9a9dc41086478d5e 2023-11-18 20:55:21,525 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231118dee4f9527cd84026818affbb6b6da73c 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:21,526 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 20:55:21,526 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231118dd034a208ace4718896776f81d19bf9a 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:21,526 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:21,526 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231118c7d96048b29a4dac91d68cabbb3f3269 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-18 20:55:21,526 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:21,526 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testCompactionWithHFileLink' and column='family1' 2023-11-18 20:55:21,527 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-18 20:55:21,529 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:21,532 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:21,536 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:21,536 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:21,542 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:21,542 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:21,558 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=283 (was 240) - Thread LEAK? -, OpenFileDescriptor=777 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 141) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 173), AvailableMemoryMB=20619 (was 20307) - AvailableMemoryMB LEAK? - 2023-11-18 20:55:21,569 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=777, MaxFileDescriptor=60000, SystemLoadAverage=151, ProcessCount=171, AvailableMemoryMB=20619 2023-11-18 20:55:21,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-18 20:55:21,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-18 20:55:21,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-18 20:55:21,580 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family2/124c8d7d73b3468c845a2f2c7e5814ca as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/124c8d7d73b3468c845a2f2c7e5814ca 2023-11-18 20:55:21,581 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-18 20:55:21,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 9 msec 2023-11-18 20:55:21,585 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f5b54a9ca2bc73b4fe66796d83446d01/family2 of f5b54a9ca2bc73b4fe66796d83446d01 into 124c8d7d73b3468c845a2f2c7e5814ca(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:21,585 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:21,585 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., storeName=f5b54a9ca2bc73b4fe66796d83446d01/family2, priority=12, startTime=1700340919979; duration=0sec 2023-11-18 20:55:21,585 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-18 20:55:21,585 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-18 20:55:21,587 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-18 20:55:21,587 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1912): a58f913bb6e2f707eed0b258698334cc/family2 is initiating minor compaction (all files) 2023-11-18 20:55:21,587 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2259): Starting compaction of a58f913bb6e2f707eed0b258698334cc/family2 in testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:55:21,587 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp, totalSize=20.4 K 2023-11-18 20:55:21,588 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340899903 2023-11-18 20:55:21,588 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340901691 2023-11-18 20:55:21,589 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340902695 2023-11-18 20:55:21,589 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340904512 2023-11-18 20:55:21,602 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] throttle.PressureAwareThroughputController(145): a58f913bb6e2f707eed0b258698334cc#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:21,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9] to archive 2023-11-18 20:55:21,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-5ae044d6bda842b18b0d1216a5036734 2023-11-18 20:55:21,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-8a64a7fd83324249894f6aa3b213f6e1 2023-11-18 20:55:21,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-1518794407964981831bd9adc2f53657 2023-11-18 20:55:21,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family2/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-d930f04e4ae14f899fb94afd452e27f9 2023-11-18 20:55:21,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-18 20:55:21,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 20:55:21,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-18 20:55:21,684 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:55:21,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-18 20:55:21,684 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:55:21,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:21,686 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:21,686 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:21,686 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751 2023-11-18 20:55:21,686 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983 empty. 2023-11-18 20:55:21,686 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751 empty. 2023-11-18 20:55:21,687 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88 empty. 2023-11-18 20:55:21,687 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:21,687 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751 2023-11-18 20:55:21,687 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:21,687 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-18 20:55:21,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:21,938 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/.tmp/family1/a0dbb62d7585476fa0de8ab3d5c430d7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/a0dbb62d7585476fa0de8ab3d5c430d7 2023-11-18 20:55:21,942 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f5b54a9ca2bc73b4fe66796d83446d01/family1 of f5b54a9ca2bc73b4fe66796d83446d01 into a0dbb62d7585476fa0de8ab3d5c430d7(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:21,942 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:55:21,942 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01., storeName=f5b54a9ca2bc73b4fe66796d83446d01/family1, priority=12, startTime=1700340919979; duration=0sec 2023-11-18 20:55:21,942 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:21,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a] to archive 2023-11-18 20:55:21,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:21,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6a2f7f2b658e4bd4b723f24ef3c779a3 2023-11-18 20:55:21,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-33f5b54ae4454abf90c71f07938ddb2a 2023-11-18 20:55:21,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-04267bf50252477b8b913b4bfc0820c0 2023-11-18 20:55:21,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/family1/testCompactionWithHFileLink=f5b54a9ca2bc73b4fe66796d83446d01-6ac776fe4654458a9f29faa9387b687a 2023-11-18 20:55:21,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:22,094 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-18 20:55:22,095 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 5ef39e57a773de83a770fde093696751, NAME => 'ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:22,095 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => f70073fffac2630f2590dc0cc876d983, NAME => 'ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:22,095 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => c4e6661d8c3acc1ec607c852cb095d88, NAME => 'ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:22,101 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,101 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing f70073fffac2630f2590dc0cc876d983, disabling compactions & flushes 2023-11-18 20:55:22,101 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,101 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,102 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. after waiting 0 ms 2023-11-18 20:55:22,102 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,102 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,102 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:22,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:22,501 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,501 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing c4e6661d8c3acc1ec607c852cb095d88, disabling compactions & flushes 2023-11-18 20:55:22,501 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,501 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,501 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 5ef39e57a773de83a770fde093696751, disabling compactions & flushes 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. after waiting 0 ms 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,502 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,502 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. after waiting 0 ms 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:22,502 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,502 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:22,504 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:55:22,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340922505"}]},"ts":"1700340922505"} 2023-11-18 20:55:22,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700340922505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340922505"}]},"ts":"1700340922505"} 2023-11-18 20:55:22,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340922505"}]},"ts":"1700340922505"} 2023-11-18 20:55:22,506 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 20:55:22,507 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:55:22,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340922507"}]},"ts":"1700340922507"} 2023-11-18 20:55:22,508 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-18 20:55:22,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f70073fffac2630f2590dc0cc876d983, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c4e6661d8c3acc1ec607c852cb095d88, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5ef39e57a773de83a770fde093696751, ASSIGN}] 2023-11-18 20:55:22,517 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f70073fffac2630f2590dc0cc876d983, ASSIGN 2023-11-18 20:55:22,518 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c4e6661d8c3acc1ec607c852cb095d88, ASSIGN 2023-11-18 20:55:22,518 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5ef39e57a773de83a770fde093696751, ASSIGN 2023-11-18 20:55:22,518 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5ef39e57a773de83a770fde093696751, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:22,518 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c4e6661d8c3acc1ec607c852cb095d88, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:22,518 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f70073fffac2630f2590dc0cc876d983, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:22,671 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4e6661d8c3acc1ec607c852cb095d88, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=5ef39e57a773de83a770fde093696751, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f70073fffac2630f2590dc0cc876d983, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700340922670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340922670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340922670"}]},"ts":"1700340922670"} 2023-11-18 20:55:22,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340922670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340922670"}]},"ts":"1700340922670"} 2023-11-18 20:55:22,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340922670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340922670"}]},"ts":"1700340922670"} 2023-11-18 20:55:22,672 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure c4e6661d8c3acc1ec607c852cb095d88, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:22,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure f70073fffac2630f2590dc0cc876d983, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:22,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 5ef39e57a773de83a770fde093696751, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:22,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:22,819 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/.tmp/family2/60f9c83b60ad4fc0bc6f8a312fb02d8d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/60f9c83b60ad4fc0bc6f8a312fb02d8d 2023-11-18 20:55:22,823 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in a58f913bb6e2f707eed0b258698334cc/family2 of a58f913bb6e2f707eed0b258698334cc into 60f9c83b60ad4fc0bc6f8a312fb02d8d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:22,823 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:55:22,823 INFO [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc., storeName=a58f913bb6e2f707eed0b258698334cc/family2, priority=12, startTime=1700340919908; duration=1sec 2023-11-18 20:55:22,823 DEBUG [RS:0;jenkins-hbase4:32871-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:22,824 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f70073fffac2630f2590dc0cc876d983, NAME => 'ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 20:55:22,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,827 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,829 DEBUG [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1 2023-11-18 20:55:22,829 DEBUG [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1 2023-11-18 20:55:22,829 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f70073fffac2630f2590dc0cc876d983 columnFamilyName family1 2023-11-18 20:55:22,830 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] regionserver.HStore(310): Store=f70073fffac2630f2590dc0cc876d983/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,830 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,832 DEBUG [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2 2023-11-18 20:55:22,832 DEBUG [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2 2023-11-18 20:55:22,832 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f70073fffac2630f2590dc0cc876d983 columnFamilyName family2 2023-11-18 20:55:22,833 INFO [StoreOpener-f70073fffac2630f2590dc0cc876d983-1] regionserver.HStore(310): Store=f70073fffac2630f2590dc0cc876d983/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:22,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f70073fffac2630f2590dc0cc876d983 2023-11-18 20:55:22,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:22,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f70073fffac2630f2590dc0cc876d983; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73158756, jitterRate=0.09015041589736938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:22,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:22,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983., pid=110, masterSystemTime=1700340922824 2023-11-18 20:55:22,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:22,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5ef39e57a773de83a770fde093696751, NAME => 'ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 20:55:22,840 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=f70073fffac2630f2590dc0cc876d983, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,840 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922840"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340922840"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340922840"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340922840"}]},"ts":"1700340922840"} 2023-11-18 20:55:22,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,841 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,842 DEBUG [StoreOpener-5ef39e57a773de83a770fde093696751-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1 2023-11-18 20:55:22,843 DEBUG [StoreOpener-5ef39e57a773de83a770fde093696751-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1 2023-11-18 20:55:22,843 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ef39e57a773de83a770fde093696751 columnFamilyName family1 2023-11-18 20:55:22,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-11-18 20:55:22,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure f70073fffac2630f2590dc0cc876d983, server=jenkins-hbase4.apache.org,32871,1700340802897 in 169 msec 2023-11-18 20:55:22,843 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] regionserver.HStore(310): Store=5ef39e57a773de83a770fde093696751/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,844 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=f70073fffac2630f2590dc0cc876d983, ASSIGN in 327 msec 2023-11-18 20:55:22,845 DEBUG [StoreOpener-5ef39e57a773de83a770fde093696751-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2 2023-11-18 20:55:22,845 DEBUG [StoreOpener-5ef39e57a773de83a770fde093696751-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2 2023-11-18 20:55:22,845 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ef39e57a773de83a770fde093696751 columnFamilyName family2 2023-11-18 20:55:22,846 INFO [StoreOpener-5ef39e57a773de83a770fde093696751-1] regionserver.HStore(310): Store=5ef39e57a773de83a770fde093696751/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:22,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5ef39e57a773de83a770fde093696751 2023-11-18 20:55:22,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:22,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5ef39e57a773de83a770fde093696751; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67535431, jitterRate=0.006356343626976013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:22,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:22,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751., pid=111, masterSystemTime=1700340922824 2023-11-18 20:55:22,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:22,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c4e6661d8c3acc1ec607c852cb095d88, NAME => 'ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 20:55:22,852 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=5ef39e57a773de83a770fde093696751, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,853 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1700340922852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340922852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340922852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340922852"}]},"ts":"1700340922852"} 2023-11-18 20:55:22,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:22,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,854 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,855 DEBUG [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1 2023-11-18 20:55:22,855 DEBUG [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1 2023-11-18 20:55:22,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-11-18 20:55:22,855 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e6661d8c3acc1ec607c852cb095d88 columnFamilyName family1 2023-11-18 20:55:22,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 5ef39e57a773de83a770fde093696751, server=jenkins-hbase4.apache.org,32871,1700340802897 in 181 msec 2023-11-18 20:55:22,856 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] regionserver.HStore(310): Store=c4e6661d8c3acc1ec607c852cb095d88/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5ef39e57a773de83a770fde093696751, ASSIGN in 339 msec 2023-11-18 20:55:22,856 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,857 DEBUG [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2 2023-11-18 20:55:22,857 DEBUG [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2 2023-11-18 20:55:22,857 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c4e6661d8c3acc1ec607c852cb095d88 columnFamilyName family2 2023-11-18 20:55:22,858 INFO [StoreOpener-c4e6661d8c3acc1ec607c852cb095d88-1] regionserver.HStore(310): Store=c4e6661d8c3acc1ec607c852cb095d88/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:22,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c] to archive 2023-11-18 20:55:22,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:22,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:22,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-16d5d74c5d9044e09e19bed4c5937ed2 2023-11-18 20:55:22,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:55:22,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-e0f566f7ab7449989b34d278962aa502 2023-11-18 20:55:22,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:22,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-9a5dc57c2342434e9165fe7626ef3719 2023-11-18 20:55:22,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c4e6661d8c3acc1ec607c852cb095d88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64939992, jitterRate=-0.032318711280822754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:22,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:22,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88., pid=109, masterSystemTime=1700340922824 2023-11-18 20:55:22,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/family2/testCompactionWithHFileLink=a58f913bb6e2f707eed0b258698334cc-5b9de12d7d134aa7a88f38fadd80f15c 2023-11-18 20:55:22,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:22,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=c4e6661d8c3acc1ec607c852cb095d88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:22,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1700340922866"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340922866"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340922866"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340922866"}]},"ts":"1700340922866"} 2023-11-18 20:55:22,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-18 20:55:22,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure c4e6661d8c3acc1ec607c852cb095d88, server=jenkins-hbase4.apache.org,32871,1700340802897 in 195 msec 2023-11-18 20:55:22,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-18 20:55:22,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c4e6661d8c3acc1ec607c852cb095d88, ASSIGN in 352 msec 2023-11-18 20:55:22,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:55:22,870 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340922870"}]},"ts":"1700340922870"} 2023-11-18 20:55:22,871 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-18 20:55:22,873 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:55:22,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.1910 sec 2023-11-18 20:55:22,975 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:55:23,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-18 20:55:23,790 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-18 20:55:23,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:23,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:23,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:23,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:23,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 20:55:23,800 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 20:55:23,800 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:23,800 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 20:55:23,800 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 20:55:23,800 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:23,800 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:23,802 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:23,802 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:23,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:23,803 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:23,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:23,803 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:23,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:23,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 20:55:23,804 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 20:55:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 20:55:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:23,804 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. started... 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. started... 2023-11-18 20:55:23,804 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. started... 2023-11-18 20:55:23,806 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f70073fffac2630f2590dc0cc876d983 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:23,806 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c4e6661d8c3acc1ec607c852cb095d88 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:23,806 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5ef39e57a773de83a770fde093696751 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:23,822 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118ecedc8179f744c84b99e1349158e6fd5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118ecedc8179f744c84b99e1349158e6fd5 2023-11-18 20:55:24,223 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182c79baff8c964bc4a15834e6e36adcd5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311182c79baff8c964bc4a15834e6e36adcd5 2023-11-18 20:55:24,223 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311182b10cdeee0514dc3ba52833d7698ce02 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311182b10cdeee0514dc3ba52833d7698ce02 2023-11-18 20:55:24,230 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/2aae36edb223499dbf364d7df03939e9 2023-11-18 20:55:24,628 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/2e668db5502e49bd980e59efee3d844b 2023-11-18 20:55:24,628 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/7e3b85f3b60b49f3948d919b9e3ada7d 2023-11-18 20:55:24,642 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118d8e817e7d1704c8fbb1a65eae9149d25 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118d8e817e7d1704c8fbb1a65eae9149d25 2023-11-18 20:55:24,646 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/d8bd3a79030e4a308c5e3d2342d90a47 2023-11-18 20:55:24,650 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/2aae36edb223499dbf364d7df03939e9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9 2023-11-18 20:55:24,653 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:24,654 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/d8bd3a79030e4a308c5e3d2342d90a47 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47 2023-11-18 20:55:24,656 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:24,657 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c4e6661d8c3acc1ec607c852cb095d88 in 851ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:24,657 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-18 20:55:24,658 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:24,658 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:24,658 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:25,047 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118ba2ede8f81f540ae8442791c109e50d3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118ba2ede8f81f540ae8442791c109e50d3 2023-11-18 20:55:25,049 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118d5e8e37f99f1443b8b7323a606df0d56 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118d5e8e37f99f1443b8b7323a606df0d56 2023-11-18 20:55:25,053 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/92f675b2f19d48cc8e694df62809bf1d 2023-11-18 20:55:25,057 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/7e3b85f3b60b49f3948d919b9e3ada7d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d 2023-11-18 20:55:25,061 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:25,061 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/92f675b2f19d48cc8e694df62809bf1d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d 2023-11-18 20:55:25,065 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:25,065 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f70073fffac2630f2590dc0cc876d983 in 1259ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:25,066 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:25,066 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:25,066 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:25,453 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/bbd5722aca5d4dedb9c1f10e12c3a718 2023-11-18 20:55:25,457 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/2e668db5502e49bd980e59efee3d844b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b 2023-11-18 20:55:25,460 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b, entries=4, sequenceid=5, filesize=5.4 K 2023-11-18 20:55:25,461 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/bbd5722aca5d4dedb9c1f10e12c3a718 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718 2023-11-18 20:55:25,464 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:25,464 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5ef39e57a773de83a770fde093696751 in 1658ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:25,464 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:25,464 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:25,464 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:25,464 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:25,464 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,465 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 20:55:25,465 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 20:55:25,466 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:25,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:25,466 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,467 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:25,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 20:55:25,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47775f42[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:25,468 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 20:55:25,468 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,469 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,469 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 20:55:25,469 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 20:55:25,469 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:25,469 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,469 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:25,471 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,471 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 20:55:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,471 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:25,471 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 20:55:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:25,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:25,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:25,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:25,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 20:55:25,473 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 20:55:25,473 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:25,473 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:25,473 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 20:55:25,473 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:25,475 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,475 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,475 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:25,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:25,476 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:25,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,478 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:25,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:25,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:25,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:25,480 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:25,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:25,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:25,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:25,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 20:55:25,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:25,480 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:25,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:25,481 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:25,581 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:25,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:25,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:25,583 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:25,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:25,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:25,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:25,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 20:55:25,588 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 20:55:25,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:25,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 20:55:25,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 20:55:25,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,588 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:25,589 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:25,589 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:25,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:25,590 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:25,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:25,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:25,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 20:55:25,596 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 20:55:25,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 20:55:25,596 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 20:55:25,597 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:25,597 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. started... 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:25,597 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:25,597 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. started... 2023-11-18 20:55:25,597 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f70073fffac2630f2590dc0cc876d983 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:25,597 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5ef39e57a773de83a770fde093696751 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:25,597 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. started... 2023-11-18 20:55:25,597 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c4e6661d8c3acc1ec607c852cb095d88 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:25,620 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311180268dcb2963c427eb3940cb27e374a70 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311180268dcb2963c427eb3940cb27e374a70 2023-11-18 20:55:25,632 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/8cf4f368b244486fae50df139fcb7de2 2023-11-18 20:55:25,636 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311188cfa1c7185c74ea39ed4f024df05346b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311188cfa1c7185c74ea39ed4f024df05346b 2023-11-18 20:55:25,650 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/bf4b4bf4cbf34a42b494a8729661a057 2023-11-18 20:55:25,655 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118688447f5536a45ef80591294326f479c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118688447f5536a45ef80591294326f479c 2023-11-18 20:55:26,035 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118ba67d50565cb482bbce92b137117f5e7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118ba67d50565cb482bbce92b137117f5e7 2023-11-18 20:55:26,062 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/56d26366eccb46af90ff5eb1589f223e 2023-11-18 20:55:26,066 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/8cf4f368b244486fae50df139fcb7de2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2 2023-11-18 20:55:26,069 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:26,070 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/56d26366eccb46af90ff5eb1589f223e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e 2023-11-18 20:55:26,073 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118600ae674b18b42d6bf3fffd5df8ca506 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118600ae674b18b42d6bf3fffd5df8ca506 2023-11-18 20:55:26,073 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:26,074 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f70073fffac2630f2590dc0cc876d983 in 477ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:26,074 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:26,074 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:26,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:26,440 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/1d91074cbe504423a4743655c09c6a9c 2023-11-18 20:55:26,478 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/b561545726ab40c29c1f330fbf9f7a9e 2023-11-18 20:55:26,481 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/bf4b4bf4cbf34a42b494a8729661a057 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057 2023-11-18 20:55:26,484 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:26,485 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/b561545726ab40c29c1f330fbf9f7a9e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e 2023-11-18 20:55:26,499 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:26,500 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:55:26,500 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41164912 to 127.0.0.1:55479 2023-11-18 20:55:26,500 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:26,500 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5ef39e57a773de83a770fde093696751 in 903ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:26,500 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:26,500 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:26,501 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:55:26,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c777ddb to 127.0.0.1:55479 2023-11-18 20:55:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:26,501 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:26,501 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:55:26,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x707c06ff to 127.0.0.1:55479 2023-11-18 20:55:26,501 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:26,856 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118d7bdfa1530fb4bc791387c03e950df72 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118d7bdfa1530fb4bc791387c03e950df72 2023-11-18 20:55:27,261 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/60dc346c182a4b6e95beea92612950c7 2023-11-18 20:55:27,265 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/1d91074cbe504423a4743655c09c6a9c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c 2023-11-18 20:55:27,268 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-18 20:55:27,269 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/60dc346c182a4b6e95beea92612950c7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7 2023-11-18 20:55:27,272 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:27,273 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c4e6661d8c3acc1ec607c852cb095d88 in 1676ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:27,273 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:27,273 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:27,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:27,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:27,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 20:55:27,273 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 20:55:27,275 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:27,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,275 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:27,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:27,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 20:55:27,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23c4c636[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:27,277 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 20:55:27,277 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,278 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 20:55:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 20:55:27,278 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:27,278 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,278 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:27,279 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 20:55:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:27,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:27,279 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 20:55:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:27,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 20:55:27,282 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 20:55:27,282 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:27,282 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:27,282 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 20:55:27,282 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:27,284 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,284 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:27,284 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:27,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:27,285 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:27,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,286 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:27,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:27,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 20:55:27,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:27,289 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:27,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:27,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,289 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:27,290 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:27,290 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:27,290 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,390 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:27,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:27,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:27,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:27,392 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:27,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:27,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:27,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 20:55:27,396 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 20:55:27,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:27,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 20:55:27,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 20:55:27,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,397 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:27,398 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,398 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:27,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:27,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:27,399 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:27,399 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:27,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:27,399 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:27,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:27,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:27,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 20:55:27,400 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 20:55:27,400 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 20:55:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 20:55:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 20:55:27,400 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:27,400 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:27,401 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:27,400 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:27,401 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:27,401 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. started... 2023-11-18 20:55:27,400 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. started... 2023-11-18 20:55:27,401 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. started... 2023-11-18 20:55:27,401 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c4e6661d8c3acc1ec607c852cb095d88 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:27,401 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5ef39e57a773de83a770fde093696751 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:27,401 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f70073fffac2630f2590dc0cc876d983 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:27,825 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118b07d215a4c00411c88633030017ca5e5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118b07d215a4c00411c88633030017ca5e5 2023-11-18 20:55:27,825 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118de9cd98739c84d6f916178b6f786c65f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118de9cd98739c84d6f916178b6f786c65f 2023-11-18 20:55:27,828 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118fa7a04029713472e9cd812c6d1bc717f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118fa7a04029713472e9cd812c6d1bc717f 2023-11-18 20:55:27,855 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/1cb363c74dfe4582a666c8145a692534 2023-11-18 20:55:28,254 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/60304d82607149ae8957bf55bbe996c9 2023-11-18 20:55:28,254 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/f0957ecac7e84b51943a4ba1f40f63ad 2023-11-18 20:55:28,266 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118bc8db08c8500444d887ddf2443e59b99 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118bc8db08c8500444d887ddf2443e59b99 2023-11-18 20:55:28,328 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:55:28,667 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182ebcc337814d42b6b6969249e4e45a9f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311182ebcc337814d42b6b6969249e4e45a9f 2023-11-18 20:55:28,667 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118b9b2d49a0060442d9657cccc44e284c8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118b9b2d49a0060442d9657cccc44e284c8 2023-11-18 20:55:28,670 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/11ee874dcb3542bb8d56501f2688dd0d 2023-11-18 20:55:28,672 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/86060fac8e56414a870a97736f7d770b 2023-11-18 20:55:28,674 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/1cb363c74dfe4582a666c8145a692534 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534 2023-11-18 20:55:28,676 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/f0957ecac7e84b51943a4ba1f40f63ad as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad 2023-11-18 20:55:28,679 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:28,679 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/11ee874dcb3542bb8d56501f2688dd0d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d 2023-11-18 20:55:28,680 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:28,681 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/86060fac8e56414a870a97736f7d770b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b 2023-11-18 20:55:28,683 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:28,684 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f70073fffac2630f2590dc0cc876d983 in 1283ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:28,684 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:28,684 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:28,684 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:28,685 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:28,685 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c4e6661d8c3acc1ec607c852cb095d88 in 1284ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:28,685 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:28,685 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:29,073 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/00332ffdb8dd4edc93fd8aa1ea75576c 2023-11-18 20:55:29,077 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/60304d82607149ae8957bf55bbe996c9 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9 2023-11-18 20:55:29,081 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9, entries=4, sequenceid=13, filesize=5.4 K 2023-11-18 20:55:29,082 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/00332ffdb8dd4edc93fd8aa1ea75576c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c 2023-11-18 20:55:29,085 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:29,086 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5ef39e57a773de83a770fde093696751 in 1685ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:29,086 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:29,086 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 20:55:29,086 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 20:55:29,088 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,088 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:29,088 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:29,088 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:29,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 20:55:29,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@736a2d61[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:29,090 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 20:55:29,090 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,092 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 20:55:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 20:55:29,092 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:29,093 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,093 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:29,094 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 20:55:29,094 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,094 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,094 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 20:55:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:29,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 20:55:29,097 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 20:55:29,097 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:29,097 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:29,097 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 20:55:29,097 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:29,101 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,101 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:29,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,101 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:29,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:29,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:29,102 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,103 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:29,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 20:55:29,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,106 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:29,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:29,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:29,106 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,107 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:29,207 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:29,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:29,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:29,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:29,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:29,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:29,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:29,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 20:55:29,213 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 20:55:29,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:29,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 20:55:29,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 20:55:29,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:29,215 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,215 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:29,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:29,215 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:29,215 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:29,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:29,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:29,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:29,216 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 20:55:29,216 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 20:55:29,216 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 20:55:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 20:55:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:29,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 20:55:29,216 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:29,217 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. started... 2023-11-18 20:55:29,217 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:29,217 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. started... 2023-11-18 20:55:29,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:29,217 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:29,217 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5ef39e57a773de83a770fde093696751 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:29,217 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. started... 2023-11-18 20:55:29,217 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:29,217 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c4e6661d8c3acc1ec607c852cb095d88 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:29,217 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f70073fffac2630f2590dc0cc876d983 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:29,229 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111871371e03119447cbb171b678dbf57eaf to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111871371e03119447cbb171b678dbf57eaf 2023-11-18 20:55:29,629 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311187616ba9c37f64deebefac8b99e36e67d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311187616ba9c37f64deebefac8b99e36e67d 2023-11-18 20:55:29,629 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e351f883ba6a44348db558bf8d191250 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118e351f883ba6a44348db558bf8d191250 2023-11-18 20:55:29,636 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/e0aa0938ec6f42178d2e276ffb31abbc 2023-11-18 20:55:29,637 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/4f08819b94c949d785ce5e328f93ca1f 2023-11-18 20:55:30,034 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/8e5fe5bc004c4965900bfdb81e8cb753 2023-11-18 20:55:30,048 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111829759190f11142a18951a2d7dfcc01c9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111829759190f11142a18951a2d7dfcc01c9 2023-11-18 20:55:30,049 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118ece9d24436f140308480044d38cd502a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118ece9d24436f140308480044d38cd502a 2023-11-18 20:55:30,447 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118962e9a3a0ad147989bd8810182ff916e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231118962e9a3a0ad147989bd8810182ff916e 2023-11-18 20:55:30,453 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/ef90c8f4f5e14ea3af9043d916512087 2023-11-18 20:55:30,453 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/9272c1eddc6e411fb9d553c0708bbd23 2023-11-18 20:55:30,457 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/e0aa0938ec6f42178d2e276ffb31abbc as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc 2023-11-18 20:55:30,458 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/4f08819b94c949d785ce5e328f93ca1f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f 2023-11-18 20:55:30,461 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:30,461 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:30,462 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/ef90c8f4f5e14ea3af9043d916512087 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087 2023-11-18 20:55:30,462 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/9272c1eddc6e411fb9d553c0708bbd23 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23 2023-11-18 20:55:30,465 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:30,466 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:30,466 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f70073fffac2630f2590dc0cc876d983 in 1249ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:30,466 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:30,466 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:30,466 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:30,467 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5ef39e57a773de83a770fde093696751 in 1250ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:30,467 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:30,467 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:30,467 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:30,852 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/9e93d0806ccd481fb051195facabdb07 2023-11-18 20:55:30,856 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/8e5fe5bc004c4965900bfdb81e8cb753 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753 2023-11-18 20:55:30,859 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753, entries=4, sequenceid=17, filesize=5.4 K 2023-11-18 20:55:30,860 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/9e93d0806ccd481fb051195facabdb07 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07 2023-11-18 20:55:30,863 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:30,864 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c4e6661d8c3acc1ec607c852cb095d88 in 1647ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:30,864 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:30,864 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 20:55:30,864 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 20:55:30,866 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,866 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:30,866 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,866 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:30,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:30,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 20:55:30,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@177f5fc5[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:30,868 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 20:55:30,868 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,870 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 20:55:30,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 20:55:30,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:30,870 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,870 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:30,872 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 20:55:30,872 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,872 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:30,872 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 20:55:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:30,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 20:55:30,874 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 20:55:30,874 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:30,875 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:30,875 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 20:55:30,875 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:30,876 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,876 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:30,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,876 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:30,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:30,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:30,877 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,878 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:30,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:30,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:30,881 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:30,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 20:55:30,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:30,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:30,881 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:30,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:30,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:30,981 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:30,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:30,990 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:30,997 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:31,004 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:31,005 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:31,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-18 20:55:31,031 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-18 20:55:31,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:31,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-18 20:55:31,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-18 20:55:31,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:31,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:31,034 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:31,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:31,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:31,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:31,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:31,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:31,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-18 20:55:31,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-18 20:55:31,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-18 20:55:31,036 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-18 20:55:31,036 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:31,036 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. started... 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. started... 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:31,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. started... 2023-11-18 20:55:31,037 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f70073fffac2630f2590dc0cc876d983 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:31,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:31,037 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5ef39e57a773de83a770fde093696751 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:31,037 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c4e6661d8c3acc1ec607c852cb095d88 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:55:31,456 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/e500c430db0c42d193dbc54be839d29c 2023-11-18 20:55:31,460 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e500c430db0c42d193dbc54be839d29c 2023-11-18 20:55:31,855 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/8563dc7e5f884d7f92eef41cfb668bbc 2023-11-18 20:55:31,858 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/55b426407ee344ba8aa9d9fc5dc4447e 2023-11-18 20:55:31,858 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8563dc7e5f884d7f92eef41cfb668bbc 2023-11-18 20:55:31,862 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55b426407ee344ba8aa9d9fc5dc4447e 2023-11-18 20:55:32,271 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/d75cea3d50084f6ea60b4aeb23fa8cb7 2023-11-18 20:55:32,272 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/84529ab1dbd6405aa9e73cda1fe559ae 2023-11-18 20:55:32,274 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d75cea3d50084f6ea60b4aeb23fa8cb7 2023-11-18 20:55:32,275 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/e500c430db0c42d193dbc54be839d29c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c 2023-11-18 20:55:32,276 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84529ab1dbd6405aa9e73cda1fe559ae 2023-11-18 20:55:32,276 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/55b426407ee344ba8aa9d9fc5dc4447e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e 2023-11-18 20:55:32,278 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e500c430db0c42d193dbc54be839d29c 2023-11-18 20:55:32,278 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,279 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/d75cea3d50084f6ea60b4aeb23fa8cb7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7 2023-11-18 20:55:32,281 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55b426407ee344ba8aa9d9fc5dc4447e 2023-11-18 20:55:32,281 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,281 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/84529ab1dbd6405aa9e73cda1fe559ae as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae 2023-11-18 20:55:32,282 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d75cea3d50084f6ea60b4aeb23fa8cb7 2023-11-18 20:55:32,282 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,283 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5ef39e57a773de83a770fde093696751 in 1246ms, sequenceid=23, compaction requested=true 2023-11-18 20:55:32,283 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:32,283 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:32,283 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:32,285 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 84529ab1dbd6405aa9e73cda1fe559ae 2023-11-18 20:55:32,285 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,286 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f70073fffac2630f2590dc0cc876d983 in 1249ms, sequenceid=23, compaction requested=true 2023-11-18 20:55:32,286 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:32,286 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:32,286 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:32,671 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/15d89be50ea34c0ebebee979fcf88176 2023-11-18 20:55:32,675 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15d89be50ea34c0ebebee979fcf88176 2023-11-18 20:55:32,675 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/8563dc7e5f884d7f92eef41cfb668bbc as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc 2023-11-18 20:55:32,678 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8563dc7e5f884d7f92eef41cfb668bbc 2023-11-18 20:55:32,679 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc, entries=3, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,679 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/15d89be50ea34c0ebebee979fcf88176 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176 2023-11-18 20:55:32,682 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 15d89be50ea34c0ebebee979fcf88176 2023-11-18 20:55:32,683 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:55:32,683 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c4e6661d8c3acc1ec607c852cb095d88 in 1646ms, sequenceid=23, compaction requested=true 2023-11-18 20:55:32,683 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:32,683 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:32,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:32,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:32,683 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-18 20:55:32,684 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-18 20:55:32,685 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,685 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:32,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:32,686 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,686 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:32,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:32,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-18 20:55:32,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a8f9f27[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:32,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-18 20:55:32,687 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,688 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-18 20:55:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-18 20:55:32,689 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:32,689 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,689 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-18 20:55:32,690 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,690 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-18 20:55:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:32,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:32,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:32,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-18 20:55:32,692 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-18 20:55:32,692 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:32,692 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:32,692 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-18 20:55:32,692 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:32,695 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,695 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,695 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:32,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:32,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:32,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,707 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-18 20:55:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,709 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:32,710 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:32,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-18 20:55:32,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-18 20:55:32,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-18 20:55:32,710 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:32,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:32,711 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:32,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:32,811 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:32,812 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:32,812 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): f70073fffac2630f2590dc0cc876d983/family1 is initiating major compaction (all files) 2023-11-18 20:55:32,812 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:32,812 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:32,812 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of f70073fffac2630f2590dc0cc876d983/family1 in ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:32,812 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp, totalSize=26.6 K 2023-11-18 20:55:32,813 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 7e3b85f3b60b49f3948d919b9e3ada7d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923795 2023-11-18 20:55:32,813 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8cf4f368b244486fae50df139fcb7de2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925583 2023-11-18 20:55:32,814 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1cb363c74dfe4582a666c8145a692534, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:32,814 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting e0aa0938ec6f42178d2e276ffb31abbc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929208 2023-11-18 20:55:32,814 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 55b426407ee344ba8aa9d9fc5dc4447e, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:32,823 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): f70073fffac2630f2590dc0cc876d983#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:32,831 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118d1496343e8dd4d9b896081f30e8aa031_del 2023-11-18 20:55:32,831 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118d1496343e8dd4d9b896081f30e8aa031_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231118d1496343e8dd4d9b896081f30e8aa031_del 2023-11-18 20:55:33,244 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8605acdd9f04bcd953ca38df8d074fb 2023-11-18 20:55:33,244 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family1/e8605acdd9f04bcd953ca38df8d074fb as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e8605acdd9f04bcd953ca38df8d074fb 2023-11-18 20:55:33,248 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8605acdd9f04bcd953ca38df8d074fb 2023-11-18 20:55:33,249 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f70073fffac2630f2590dc0cc876d983/family1 of f70073fffac2630f2590dc0cc876d983 into e8605acdd9f04bcd953ca38df8d074fb(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:33,249 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:33,249 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:33,249 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): f70073fffac2630f2590dc0cc876d983/family2 is initiating major compaction (all files) 2023-11-18 20:55:33,249 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:33,249 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:33,250 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of f70073fffac2630f2590dc0cc876d983/family2 in ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:55:33,250 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp, totalSize=25.3 K 2023-11-18 20:55:33,250 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 92f675b2f19d48cc8e694df62809bf1d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923795 2023-11-18 20:55:33,251 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 56d26366eccb46af90ff5eb1589f223e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925583 2023-11-18 20:55:33,251 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 11ee874dcb3542bb8d56501f2688dd0d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:33,251 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting ef90c8f4f5e14ea3af9043d916512087, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929208 2023-11-18 20:55:33,251 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 84529ab1dbd6405aa9e73cda1fe559ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:33,259 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): f70073fffac2630f2590dc0cc876d983#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:33,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e] to archive 2023-11-18 20:55:33,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:33,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/7e3b85f3b60b49f3948d919b9e3ada7d 2023-11-18 20:55:33,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/8cf4f368b244486fae50df139fcb7de2 2023-11-18 20:55:33,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/1cb363c74dfe4582a666c8145a692534 2023-11-18 20:55:33,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/e0aa0938ec6f42178d2e276ffb31abbc 2023-11-18 20:55:33,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/55b426407ee344ba8aa9d9fc5dc4447e 2023-11-18 20:55:33,667 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118209f8cdb5641431f9ffa8456fb4e60b7_del 2023-11-18 20:55:33,667 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118209f8cdb5641431f9ffa8456fb4e60b7_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231118209f8cdb5641431f9ffa8456fb4e60b7_del 2023-11-18 20:55:34,480 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22e332d656f0478ba3f4a1a60af653b2 2023-11-18 20:55:34,481 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/.tmp/family2/22e332d656f0478ba3f4a1a60af653b2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/22e332d656f0478ba3f4a1a60af653b2 2023-11-18 20:55:34,484 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22e332d656f0478ba3f4a1a60af653b2 2023-11-18 20:55:34,485 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f70073fffac2630f2590dc0cc876d983/family2 of f70073fffac2630f2590dc0cc876d983 into 22e332d656f0478ba3f4a1a60af653b2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:34,485 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:34,485 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:34,485 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 5ef39e57a773de83a770fde093696751/family1 is initiating major compaction (all files) 2023-11-18 20:55:34,485 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:34,485 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:34,486 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 5ef39e57a773de83a770fde093696751/family1 in ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:34,486 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp, totalSize=26.6 K 2023-11-18 20:55:34,486 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 2e668db5502e49bd980e59efee3d844b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923796 2023-11-18 20:55:34,486 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting bf4b4bf4cbf34a42b494a8729661a057, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925584 2023-11-18 20:55:34,487 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 60304d82607149ae8957bf55bbe996c9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:34,487 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 4f08819b94c949d785ce5e328f93ca1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929209 2023-11-18 20:55:34,487 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting e500c430db0c42d193dbc54be839d29c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:34,495 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 5ef39e57a773de83a770fde093696751#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:34,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae] to archive 2023-11-18 20:55:34,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:34,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/92f675b2f19d48cc8e694df62809bf1d 2023-11-18 20:55:34,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/56d26366eccb46af90ff5eb1589f223e 2023-11-18 20:55:34,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/11ee874dcb3542bb8d56501f2688dd0d 2023-11-18 20:55:34,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/ef90c8f4f5e14ea3af9043d916512087 2023-11-18 20:55:34,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family2/84529ab1dbd6405aa9e73cda1fe559ae 2023-11-18 20:55:34,902 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118861b88fd334e4bccbab1c9c5eccdfa34_del 2023-11-18 20:55:34,903 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118861b88fd334e4bccbab1c9c5eccdfa34_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231118861b88fd334e4bccbab1c9c5eccdfa34_del 2023-11-18 20:55:35,316 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 771d332f114943828e9398b55dbafbf7 2023-11-18 20:55:35,317 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family1/771d332f114943828e9398b55dbafbf7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/771d332f114943828e9398b55dbafbf7 2023-11-18 20:55:35,320 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 771d332f114943828e9398b55dbafbf7 2023-11-18 20:55:35,321 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5ef39e57a773de83a770fde093696751/family1 of 5ef39e57a773de83a770fde093696751 into 771d332f114943828e9398b55dbafbf7(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:35,321 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:35,321 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:35,321 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 5ef39e57a773de83a770fde093696751/family2 is initiating major compaction (all files) 2023-11-18 20:55:35,321 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:35,321 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:35,322 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 5ef39e57a773de83a770fde093696751/family2 in ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:55:35,322 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp, totalSize=25.3 K 2023-11-18 20:55:35,323 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting bbd5722aca5d4dedb9c1f10e12c3a718, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923796 2023-11-18 20:55:35,323 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting b561545726ab40c29c1f330fbf9f7a9e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925584 2023-11-18 20:55:35,323 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 00332ffdb8dd4edc93fd8aa1ea75576c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:35,324 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 9272c1eddc6e411fb9d553c0708bbd23, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929209 2023-11-18 20:55:35,324 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting d75cea3d50084f6ea60b4aeb23fa8cb7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:35,339 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 5ef39e57a773de83a770fde093696751#family2#compaction#153 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:35,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c] to archive 2023-11-18 20:55:35,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:35,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/2e668db5502e49bd980e59efee3d844b 2023-11-18 20:55:35,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/bf4b4bf4cbf34a42b494a8729661a057 2023-11-18 20:55:35,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/60304d82607149ae8957bf55bbe996c9 2023-11-18 20:55:35,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/4f08819b94c949d785ce5e328f93ca1f 2023-11-18 20:55:35,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/e500c430db0c42d193dbc54be839d29c 2023-11-18 20:55:35,747 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118e31c7327f4774b59a83ed60447be6f7d_del 2023-11-18 20:55:35,747 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e31c7327f4774b59a83ed60447be6f7d_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231118e31c7327f4774b59a83ed60447be6f7d_del 2023-11-18 20:55:36,562 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 538dc0f7589a4efcbd95741ae0288376 2023-11-18 20:55:36,563 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/.tmp/family2/538dc0f7589a4efcbd95741ae0288376 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/538dc0f7589a4efcbd95741ae0288376 2023-11-18 20:55:36,567 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 538dc0f7589a4efcbd95741ae0288376 2023-11-18 20:55:36,568 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5ef39e57a773de83a770fde093696751/family2 of 5ef39e57a773de83a770fde093696751 into 538dc0f7589a4efcbd95741ae0288376(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:36,568 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:36,568 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:36,569 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): c4e6661d8c3acc1ec607c852cb095d88/family1 is initiating major compaction (all files) 2023-11-18 20:55:36,569 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:36,569 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:36,569 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of c4e6661d8c3acc1ec607c852cb095d88/family1 in ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:36,570 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp, totalSize=26.6 K 2023-11-18 20:55:36,570 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 2aae36edb223499dbf364d7df03939e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923796 2023-11-18 20:55:36,570 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1d91074cbe504423a4743655c09c6a9c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925583 2023-11-18 20:55:36,571 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting f0957ecac7e84b51943a4ba1f40f63ad, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:36,571 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8e5fe5bc004c4965900bfdb81e8cb753, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929209 2023-11-18 20:55:36,571 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8563dc7e5f884d7f92eef41cfb668bbc, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:36,580 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): c4e6661d8c3acc1ec607c852cb095d88#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:36,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7] to archive 2023-11-18 20:55:36,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:36,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/bbd5722aca5d4dedb9c1f10e12c3a718 2023-11-18 20:55:36,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/b561545726ab40c29c1f330fbf9f7a9e 2023-11-18 20:55:36,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/00332ffdb8dd4edc93fd8aa1ea75576c 2023-11-18 20:55:36,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/9272c1eddc6e411fb9d553c0708bbd23 2023-11-18 20:55:36,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family2/d75cea3d50084f6ea60b4aeb23fa8cb7 2023-11-18 20:55:36,988 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118e25210ab579047e089ed2c9a9e56e380_del 2023-11-18 20:55:36,988 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118e25210ab579047e089ed2c9a9e56e380_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118e25210ab579047e089ed2c9a9e56e380_del 2023-11-18 20:55:37,802 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 224e19a884f14914a60aee699b8ddf64 2023-11-18 20:55:37,803 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family1/224e19a884f14914a60aee699b8ddf64 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/224e19a884f14914a60aee699b8ddf64 2023-11-18 20:55:37,807 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 224e19a884f14914a60aee699b8ddf64 2023-11-18 20:55:37,808 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c4e6661d8c3acc1ec607c852cb095d88/family1 of c4e6661d8c3acc1ec607c852cb095d88 into 224e19a884f14914a60aee699b8ddf64(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:37,808 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:37,808 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:55:37,808 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): c4e6661d8c3acc1ec607c852cb095d88/family2 is initiating major compaction (all files) 2023-11-18 20:55:37,809 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:55:37,809 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:55:37,809 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of c4e6661d8c3acc1ec607c852cb095d88/family2 in ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:55:37,810 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp, totalSize=25.3 K 2023-11-18 20:55:37,810 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting d8bd3a79030e4a308c5e3d2342d90a47, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340923796 2023-11-18 20:55:37,810 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 60dc346c182a4b6e95beea92612950c7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340925583 2023-11-18 20:55:37,811 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 86060fac8e56414a870a97736f7d770b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340927392 2023-11-18 20:55:37,811 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 9e93d0806ccd481fb051195facabdb07, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340929209 2023-11-18 20:55:37,811 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 15d89be50ea34c0ebebee979fcf88176, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:55:37,822 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): c4e6661d8c3acc1ec607c852cb095d88#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:37,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc] to archive 2023-11-18 20:55:37,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:37,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/2aae36edb223499dbf364d7df03939e9 2023-11-18 20:55:37,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/1d91074cbe504423a4743655c09c6a9c 2023-11-18 20:55:37,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/f0957ecac7e84b51943a4ba1f40f63ad 2023-11-18 20:55:37,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8e5fe5bc004c4965900bfdb81e8cb753 2023-11-18 20:55:37,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/8563dc7e5f884d7f92eef41cfb668bbc 2023-11-18 20:55:38,234 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023111826dff988f0d14930bf532ed4a6b020d6_del 2023-11-18 20:55:38,234 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111826dff988f0d14930bf532ed4a6b020d6_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023111826dff988f0d14930bf532ed4a6b020d6_del 2023-11-18 20:55:39,048 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eabeeeffb2d54dfeb9fe43e3c274ee6d 2023-11-18 20:55:39,048 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/.tmp/family2/eabeeeffb2d54dfeb9fe43e3c274ee6d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/eabeeeffb2d54dfeb9fe43e3c274ee6d 2023-11-18 20:55:39,051 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eabeeeffb2d54dfeb9fe43e3c274ee6d 2023-11-18 20:55:39,052 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c4e6661d8c3acc1ec607c852cb095d88/family2 of c4e6661d8c3acc1ec607c852cb095d88 into eabeeeffb2d54dfeb9fe43e3c274ee6d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:55:39,052 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:39,055 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:39,058 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:39,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176] to archive 2023-11-18 20:55:39,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:39,061 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:39,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/d8bd3a79030e4a308c5e3d2342d90a47 2023-11-18 20:55:39,062 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:39,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/60dc346c182a4b6e95beea92612950c7 2023-11-18 20:55:39,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/86060fac8e56414a870a97736f7d770b 2023-11-18 20:55:39,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/9e93d0806ccd481fb051195facabdb07 2023-11-18 20:55:39,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family2/15d89be50ea34c0ebebee979fcf88176 2023-11-18 20:55:39,067 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:55:39,081 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-18 20:55:39,084 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118d1496343e8dd4d9b896081f30e8aa031_del 2023-11-18 20:55:39,087 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118e25210ab579047e089ed2c9a9e56e380_del 2023-11-18 20:55:39,090 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118861b88fd334e4bccbab1c9c5eccdfa34_del 2023-11-18 20:55:39,090 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:39,091 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(139): Connect 0x0b5b37d7 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:39,095 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69467a07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:39,097 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:39,097 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:39,097 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:39,929 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311180090e4f1dff54542ad7a797725a2d428 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311180090e4f1dff54542ad7a797725a2d428 2023-11-18 20:55:39,929 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311182491b0c0b4e24943921b749f9eb6b7c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311182491b0c0b4e24943921b749f9eb6b7c7 2023-11-18 20:55:39,929 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118fd7a646f6b7943c48f44118bd4f5cd02 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118fd7a646f6b7943c48f44118bd4f5cd02 2023-11-18 20:55:39,930 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:39,930 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:39,930 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:39,944 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:39,946 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:39,953 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:55:39,963 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:55:39,996 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/ca74205bc9464ca1adbc2918033453e8 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-18 20:55:39,996 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/ca74205bc9464ca1adbc2918033453e8}] 2023-11-18 20:55:39,997 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/375de8d2ee494015be8c3ee89af310b4 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-18 20:55:39,999 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/67d6d9ca00274acfa954d03cf655917f first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-18 20:55:40,001 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/375de8d2ee494015be8c3ee89af310b4}] 2023-11-18 20:55:40,001 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/67d6d9ca00274acfa954d03cf655917f}] 2023-11-18 20:55:40,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/ca74205bc9464ca1adbc2918033453e8 for inclusion in f70073fffac2630f2590dc0cc876d983/family1 2023-11-18 20:55:40,005 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/67d6d9ca00274acfa954d03cf655917f for inclusion in c4e6661d8c3acc1ec607c852cb095d88/family1 2023-11-18 20:55:40,005 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/375de8d2ee494015be8c3ee89af310b4 for inclusion in 5ef39e57a773de83a770fde093696751/family1 2023-11-18 20:55:40,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-18 20:55:40,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 20:55:40,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:55:40,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-18 20:55:40,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 20:55:40,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118/family1/ca74205bc9464ca1adbc2918033453e8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__lb02aohvnst6orm7ipd828ctictd1sei81tkvbt6onp98m54udl3317a0kfol5dn/family1/ca74205bc9464ca1adbc2918033453e8 2023-11-18 20:55:40,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:55:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-18 20:55:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 20:55:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:55:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118/family1/67d6d9ca00274acfa954d03cf655917f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__6kfm3gp3ecbkm0a9m3f3pqnng03juahjj5vpbqn49irmug0c52ap7l5r358o3tu/family1/67d6d9ca00274acfa954d03cf655917f 2023-11-18 20:55:40,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118/family1/375de8d2ee494015be8c3ee89af310b4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__800metah18dem6mtfbe23g3j6c28f1ej97052hfu1legqscqn625k8hv98mi2uru/family1/375de8d2ee494015be8c3ee89af310b4 2023-11-18 20:55:40,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__lb02aohvnst6orm7ipd828ctictd1sei81tkvbt6onp98m54udl3317a0kfol5dn/family1/ca74205bc9464ca1adbc2918033453e8 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/68d9a3b17bf04d88bb42f300635af590_SeqId_28_ 2023-11-18 20:55:40,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__lb02aohvnst6orm7ipd828ctictd1sei81tkvbt6onp98m54udl3317a0kfol5dn/family1/ca74205bc9464ca1adbc2918033453e8 into f70073fffac2630f2590dc0cc876d983/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/68d9a3b17bf04d88bb42f300635af590_SeqId_28_ - updating store file list. 2023-11-18 20:55:40,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__6kfm3gp3ecbkm0a9m3f3pqnng03juahjj5vpbqn49irmug0c52ap7l5r358o3tu/family1/67d6d9ca00274acfa954d03cf655917f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/00ffdf55166443c1ba59e5cd29fe3771_SeqId_28_ 2023-11-18 20:55:40,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__800metah18dem6mtfbe23g3j6c28f1ej97052hfu1legqscqn625k8hv98mi2uru/family1/375de8d2ee494015be8c3ee89af310b4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/78b7b3ea3152412594f2e6b17c671916_SeqId_28_ 2023-11-18 20:55:40,012 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__6kfm3gp3ecbkm0a9m3f3pqnng03juahjj5vpbqn49irmug0c52ap7l5r358o3tu/family1/67d6d9ca00274acfa954d03cf655917f into c4e6661d8c3acc1ec607c852cb095d88/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/00ffdf55166443c1ba59e5cd29fe3771_SeqId_28_ - updating store file list. 2023-11-18 20:55:40,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__800metah18dem6mtfbe23g3j6c28f1ej97052hfu1legqscqn625k8hv98mi2uru/family1/375de8d2ee494015be8c3ee89af310b4 into 5ef39e57a773de83a770fde093696751/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/78b7b3ea3152412594f2e6b17c671916_SeqId_28_ - updating store file list. 2023-11-18 20:55:40,016 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/00ffdf55166443c1ba59e5cd29fe3771_SeqId_28_ into c4e6661d8c3acc1ec607c852cb095d88/family1 2023-11-18 20:55:40,016 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__6kfm3gp3ecbkm0a9m3f3pqnng03juahjj5vpbqn49irmug0c52ap7l5r358o3tu/family1/67d6d9ca00274acfa954d03cf655917f into c4e6661d8c3acc1ec607c852cb095d88/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/family1/00ffdf55166443c1ba59e5cd29fe3771_SeqId_28_) 2023-11-18 20:55:40,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__6kfm3gp3ecbkm0a9m3f3pqnng03juahjj5vpbqn49irmug0c52ap7l5r358o3tu/family1/67d6d9ca00274acfa954d03cf655917f 2023-11-18 20:55:40,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/68d9a3b17bf04d88bb42f300635af590_SeqId_28_ into f70073fffac2630f2590dc0cc876d983/family1 2023-11-18 20:55:40,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__lb02aohvnst6orm7ipd828ctictd1sei81tkvbt6onp98m54udl3317a0kfol5dn/family1/ca74205bc9464ca1adbc2918033453e8 into f70073fffac2630f2590dc0cc876d983/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/family1/68d9a3b17bf04d88bb42f300635af590_SeqId_28_) 2023-11-18 20:55:40,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__lb02aohvnst6orm7ipd828ctictd1sei81tkvbt6onp98m54udl3317a0kfol5dn/family1/ca74205bc9464ca1adbc2918033453e8 2023-11-18 20:55:40,018 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/78b7b3ea3152412594f2e6b17c671916_SeqId_28_ into 5ef39e57a773de83a770fde093696751/family1 2023-11-18 20:55:40,019 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__800metah18dem6mtfbe23g3j6c28f1ej97052hfu1legqscqn625k8hv98mi2uru/family1/375de8d2ee494015be8c3ee89af310b4 into 5ef39e57a773de83a770fde093696751/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/family1/78b7b3ea3152412594f2e6b17c671916_SeqId_28_) 2023-11-18 20:55:40,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__ns_testMinorCompaction__800metah18dem6mtfbe23g3j6c28f1ej97052hfu1legqscqn625k8hv98mi2uru/family1/375de8d2ee494015be8c3ee89af310b4 2023-11-18 20:55:40,020 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:40,020 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:40,021 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:40,021 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:40,021 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:40,023 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:40,023 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311182b10cdeee0514dc3ba52833d7698ce02 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311182b10cdeee0514dc3ba52833d7698ce02 2023-11-18 20:55:40,023 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 20:55:40,023 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 20:55:40,024 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118ecedc8179f744c84b99e1349158e6fd5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231118ecedc8179f744c84b99e1349158e6fd5 2023-11-18 20:55:40,024 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 20:55:40,024 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 20:55:40,024 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:40,024 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:40,024 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311182c79baff8c964bc4a15834e6e36adcd5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311182c79baff8c964bc4a15834e6e36adcd5 2023-11-18 20:55:40,024 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-18 20:55:40,024 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 20:55:40,025 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='ns:testMinorCompaction' and column='family1' 2023-11-18 20:55:40,025 INFO [Listener at localhost/41997] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-18 20:55:40,027 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:40,029 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:40,031 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:55:40,032 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:55:40,049 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 283), OpenFileDescriptor=649 (was 777), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 151), ProcessCount=171 (was 171), AvailableMemoryMB=20772 (was 20619) - AvailableMemoryMB LEAK? - 2023-11-18 20:55:40,061 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=649, MaxFileDescriptor=60000, SystemLoadAverage=137, ProcessCount=171, AvailableMemoryMB=20772 2023-11-18 20:55:40,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-18 20:55:40,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:40,065 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:55:40,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-18 20:55:40,066 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:55:40,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:40,067 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:40,067 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c empty. 2023-11-18 20:55:40,067 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:40,067 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-18 20:55:40,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:40,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:40,474 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-18 20:55:40,475 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1e6988a556cb073a80193c0ff852e78c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:40,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:40,880 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:40,880 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 1e6988a556cb073a80193c0ff852e78c, disabling compactions & flushes 2023-11-18 20:55:40,881 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:40,881 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:40,881 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. after waiting 0 ms 2023-11-18 20:55:40,881 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:40,881 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:40,881 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:40,883 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:55:40,883 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340940883"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340940883"}]},"ts":"1700340940883"} 2023-11-18 20:55:40,885 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-18 20:55:40,885 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:55:40,885 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340940885"}]},"ts":"1700340940885"} 2023-11-18 20:55:40,886 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-18 20:55:40,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1e6988a556cb073a80193c0ff852e78c, ASSIGN}] 2023-11-18 20:55:40,890 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1e6988a556cb073a80193c0ff852e78c, ASSIGN 2023-11-18 20:55:40,891 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1e6988a556cb073a80193c0ff852e78c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:41,042 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=1e6988a556cb073a80193c0ff852e78c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:41,042 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340941042"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340941042"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340941042"}]},"ts":"1700340941042"} 2023-11-18 20:55:41,044 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 1e6988a556cb073a80193c0ff852e78c, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:41,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:41,195 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:41,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:41,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e6988a556cb073a80193c0ff852e78c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.', STARTKEY => '', ENDKEY => ''} 2023-11-18 20:55:41,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:41,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,199 INFO [StoreOpener-1e6988a556cb073a80193c0ff852e78c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,200 DEBUG [StoreOpener-1e6988a556cb073a80193c0ff852e78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:41,201 DEBUG [StoreOpener-1e6988a556cb073a80193c0ff852e78c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:41,201 INFO [StoreOpener-1e6988a556cb073a80193c0ff852e78c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e6988a556cb073a80193c0ff852e78c columnFamilyName family1 2023-11-18 20:55:41,202 INFO [StoreOpener-1e6988a556cb073a80193c0ff852e78c-1] regionserver.HStore(310): Store=1e6988a556cb073a80193c0ff852e78c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:41,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:55:41,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:41,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e6988a556cb073a80193c0ff852e78c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73648708, jitterRate=0.09745126962661743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-18 20:55:41,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:41,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., pid=114, masterSystemTime=1700340941195 2023-11-18 20:55:41,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:41,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:41,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=1e6988a556cb073a80193c0ff852e78c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:41,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1700340941209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340941209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340941209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340941209"}]},"ts":"1700340941209"} 2023-11-18 20:55:41,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-18 20:55:41,211 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 1e6988a556cb073a80193c0ff852e78c, server=jenkins-hbase4.apache.org,32871,1700340802897 in 167 msec 2023-11-18 20:55:41,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-18 20:55:41,212 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=1e6988a556cb073a80193c0ff852e78c, ASSIGN in 322 msec 2023-11-18 20:55:41,213 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:55:41,213 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340941213"}]},"ts":"1700340941213"} 2023-11-18 20:55:41,214 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-18 20:55:41,218 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:55:41,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1550 sec 2023-11-18 20:55:42,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-18 20:55:42,171 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-18 20:55:42,186 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:42,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,187 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:42,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:42,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:42,187 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:42,188 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,188 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,190 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:42,190 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:42,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:42,190 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:42,190 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:42,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:42,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:42,191 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:42,192 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:42,192 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:42,193 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-18 20:55:42,625 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305dbafe2676ea4d6bba717addc98c5ffe to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305dbafe2676ea4d6bba717addc98c5ffe 2023-11-18 20:55:43,028 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/71d36ec5b69b48f898f33983335a4d3d 2023-11-18 20:55:43,032 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/71d36ec5b69b48f898f33983335a4d3d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d 2023-11-18 20:55:43,036 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-18 20:55:43,036 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 843ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:43,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:43,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:43,037 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:43,037 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:43,042 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:43,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,042 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:43,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:43,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fff1136[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:43,044 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:43,044 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,045 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,045 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:43,045 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:43,045 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:43,045 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,045 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:43,046 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:43,046 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,046 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:43,047 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:43,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:43,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:43,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:43,049 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:43,049 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:43,049 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:43,049 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,049 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:43,052 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,052 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,052 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:43,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:43,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:43,053 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,054 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:43,056 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:43,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:43,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:43,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:43,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:43,056 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,057 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,057 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,057 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:43,057 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:43,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:43,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:43,157 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:43,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:43,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:43,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,163 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:43,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:43,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:43,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:43,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,163 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,164 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,164 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:43,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:43,165 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,165 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,165 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,166 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,166 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:43,166 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:43,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:43,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:43,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:43,166 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:43,166 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:43,166 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:43,166 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-18 20:55:43,581 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d9f31f94a0124ae7bc0d806f43cff859 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d9f31f94a0124ae7bc0d806f43cff859 2023-11-18 20:55:43,986 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/857c624b06f14ba8bc82336ea64b730d 2023-11-18 20:55:43,990 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/857c624b06f14ba8bc82336ea64b730d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d 2023-11-18 20:55:43,994 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-18 20:55:43,995 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 829ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:43,995 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:43,995 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:43,995 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:43,997 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,997 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:43,997 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,997 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:43,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:43,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:43,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:43,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d5c288d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:43,999 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:43,999 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,001 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,001 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:44,001 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:44,001 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:44,001 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,001 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:44,002 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:44,002 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:44,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:44,005 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:44,005 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:44,005 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:44,005 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,005 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:44,006 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,006 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:44,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,006 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:44,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:44,007 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,008 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,010 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,010 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:44,010 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:44,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,011 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:44,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,011 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:44,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:44,111 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:44,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:44,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:44,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:44,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,118 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:44,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:44,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:44,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:44,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,118 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,120 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:44,120 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:44,121 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,121 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:44,121 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:44,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,122 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,122 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:44,122 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:44,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:44,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:44,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:44,122 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:44,122 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:44,122 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:44,122 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:44,533 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010ed4df412f574558806542367cd02d56 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010ed4df412f574558806542367cd02d56 2023-11-18 20:55:44,938 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/9b6473cbbd964ecd9c57a834ea6bb874 2023-11-18 20:55:44,942 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/9b6473cbbd964ecd9c57a834ea6bb874 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874 2023-11-18 20:55:44,945 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874, entries=1, sequenceid=13, filesize=4.9 K 2023-11-18 20:55:44,945 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 823ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:44,945 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:44,945 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:44,946 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:44,947 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,947 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:44,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,948 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:44,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:44,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:44,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2030d794[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:44,949 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:44,949 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,950 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:44,951 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,951 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:44,952 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,952 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:44,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:44,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:44,955 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:44,955 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:44,955 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:44,955 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,955 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:44,957 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,957 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:44,957 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:44,958 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:44,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,959 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:44,964 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:44,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:44,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:44,964 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:44,965 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:45,065 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:45,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:45,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:45,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:45,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,071 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:45,071 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:45,071 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:45,071 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:45,071 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,071 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,072 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,072 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:45,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:45,073 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,073 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:45,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:45,074 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:45,074 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:45,074 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:45,074 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:45,485 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205faf270b6efa948ad99f812b3673e3a03 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205faf270b6efa948ad99f812b3673e3a03 2023-11-18 20:55:45,890 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/f9a7c9e963e546fba80d3f16e88d641d 2023-11-18 20:55:45,893 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/f9a7c9e963e546fba80d3f16e88d641d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d 2023-11-18 20:55:45,897 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d, entries=1, sequenceid=17, filesize=4.9 K 2023-11-18 20:55:45,898 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 824ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:45,898 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:45,898 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:45,898 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:45,900 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,900 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:45,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,901 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:45,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36501212[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:45,902 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:45,902 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,903 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,904 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:45,904 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:45,904 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:45,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,904 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:45,906 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:45,906 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,906 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:45,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:45,906 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:45,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:45,909 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:45,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:45,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:45,909 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,909 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:45,910 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,910 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:45,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,910 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:45,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:45,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,912 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:45,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:45,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:45,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:45,915 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:45,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:45,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:45,915 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:46,015 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:46,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:46,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:46,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,022 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:46,022 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:46,022 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:46,022 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:46,022 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,022 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,023 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,023 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:46,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:46,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:46,024 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,024 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:46,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,025 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:46,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:46,025 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:46,028 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:46,028 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:46,028 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:46,028 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:46,439 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f68b8835b70f4aaab15855470c812321 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f68b8835b70f4aaab15855470c812321 2023-11-18 20:55:46,736 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:55:46,844 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/fd5d98450e8a40378ae8981598f34741 2023-11-18 20:55:46,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/fd5d98450e8a40378ae8981598f34741 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741 2023-11-18 20:55:46,851 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741, entries=1, sequenceid=21, filesize=4.9 K 2023-11-18 20:55:46,852 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 824ms, sequenceid=21, compaction requested=true 2023-11-18 20:55:46,852 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:46,852 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:46,852 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:46,852 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:46,852 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,852 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:46,852 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:46,855 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:46,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:46,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:46,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:46,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2131d34f[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:46,857 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:46,857 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,858 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:46,858 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:46,858 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,858 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:46,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:46,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:46,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:46,859 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:46,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:46,862 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:46,862 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:46,862 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:46,862 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,862 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:46,863 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,863 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,864 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:46,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:46,864 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:46,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:46,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,865 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:46,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:46,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:46,869 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:46,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:46,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:46,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:46,869 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:46,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:46,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:46,969 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:46,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:46,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:46,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:46,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,975 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:46,975 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:46,975 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:46,975 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:46,976 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,976 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,977 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,977 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:46,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:46,977 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:46,977 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:46,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,978 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,978 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:46,978 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:46,978 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:46,979 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:46,979 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:46,979 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:46,979 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:46,989 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231842b922d37904beca734b970e12a4662 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231842b922d37904beca734b970e12a4662 2023-11-18 20:55:47,394 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/04ea24b50b794da698bc3bc4402e3d8e 2023-11-18 20:55:47,398 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/04ea24b50b794da698bc3bc4402e3d8e as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e 2023-11-18 20:55:47,401 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e, entries=1, sequenceid=25, filesize=4.9 K 2023-11-18 20:55:47,402 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 423ms, sequenceid=25, compaction requested=true 2023-11-18 20:55:47,402 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:47,402 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:47,402 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:47,402 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:47,402 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,402 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:47,402 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:47,404 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,404 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:47,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:47,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d859fa4[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:47,406 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:47,406 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,407 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:47,407 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:47,407 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,407 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:47,413 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:47,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:47,415 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:47,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:47,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:47,415 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,415 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:47,416 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,416 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,416 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:47,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:47,417 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,418 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,420 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:47,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:47,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:47,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:47,420 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:47,421 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,421 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,421 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,421 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:47,421 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:47,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:47,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:47,521 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:47,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:47,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:47,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:47,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,526 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:47,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:47,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:47,526 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:47,527 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,527 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,529 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,529 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:47,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:47,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:47,529 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,529 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,530 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:47,530 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,530 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:47,530 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:47,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:47,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:47,531 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:47,531 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:47,531 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:47,531 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:47,541 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013fd2a35cbc2d4b0abf2ddec56478493e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fd2a35cbc2d4b0abf2ddec56478493e 2023-11-18 20:55:47,946 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/2d18e3bbf85d46608e8d35c0f872078a 2023-11-18 20:55:47,950 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/2d18e3bbf85d46608e8d35c0f872078a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a 2023-11-18 20:55:47,953 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a, entries=1, sequenceid=29, filesize=4.9 K 2023-11-18 20:55:47,954 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 423ms, sequenceid=29, compaction requested=true 2023-11-18 20:55:47,954 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:47,954 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:47,954 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,956 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,956 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:47,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b2f65f7[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:47,958 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:47,958 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,959 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:47,960 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,960 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:47,960 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:47,961 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,961 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:47,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:47,963 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:47,964 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:47,964 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:47,964 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,964 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:47,966 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,966 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:47,967 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:47,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:47,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:47,967 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,968 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:47,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:47,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:47,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:47,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:47,971 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:47,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:47,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:47,972 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:47,971 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,072 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:48,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:48,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:48,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:48,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,078 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:48,078 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:48,078 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:48,078 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:48,079 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,079 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,080 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,080 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:48,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:48,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:48,080 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,080 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:48,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,081 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:48,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,081 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,081 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:48,081 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:48,081 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:48,081 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:48,082 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:48,082 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:48,494 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d5c8fef7e6014bfea99851fb4fd6a1dc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d5c8fef7e6014bfea99851fb4fd6a1dc 2023-11-18 20:55:48,899 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/60f4f72dbf0a4373b1e192459531e170 2023-11-18 20:55:48,903 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/60f4f72dbf0a4373b1e192459531e170 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170 2023-11-18 20:55:48,906 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170, entries=1, sequenceid=33, filesize=4.9 K 2023-11-18 20:55:48,907 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 825ms, sequenceid=33, compaction requested=true 2023-11-18 20:55:48,907 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:48,907 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,907 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:48,908 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:48,909 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,909 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:48,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:48,910 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,910 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:48,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:48,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1dd92202[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:48,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:48,911 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,914 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:48,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:48,914 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:48,916 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:48,916 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:48,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:48,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:48,918 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:48,918 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:48,918 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:48,918 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:48,918 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,918 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:48,920 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,920 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:48,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,920 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:48,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:48,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:48,921 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,922 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,924 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:48,924 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:48,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:48,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:48,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:48,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,924 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:48,925 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:48,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:48,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:48,925 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:49,025 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:49,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:49,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:49,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,031 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,034 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:49,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,035 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,035 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:49,035 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:49,035 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:49,035 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:49,035 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:49,036 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:49,446 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bbc401bcd52d4e94aaec77caeb516f6d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907bbc401bcd52d4e94aaec77caeb516f6d 2023-11-18 20:55:49,851 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/7b213ef73a96404d9a0591d44081ba73 2023-11-18 20:55:49,855 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/7b213ef73a96404d9a0591d44081ba73 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73 2023-11-18 20:55:49,859 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73, entries=1, sequenceid=37, filesize=4.9 K 2023-11-18 20:55:49,859 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 823ms, sequenceid=37, compaction requested=true 2023-11-18 20:55:49,859 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:49,859 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:49,859 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:49,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:49,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:49,860 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:49,865 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,865 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:49,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:49,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@325d215d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:49,867 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:49,867 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,868 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:49,868 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,868 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:49,869 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:49,869 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:49,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:49,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:49,870 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,870 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:49,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:49,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:49,873 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:49,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:49,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:49,873 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,873 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:49,875 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,875 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:49,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,875 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:49,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:49,876 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,877 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,879 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,879 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,879 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:49,879 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:49,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,879 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:49,879 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:49,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:49,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:49,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:49,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:49,880 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:49,980 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:49,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:49,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:49,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:49,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,986 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:49,986 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:49,986 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-18 20:55:49,986 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-18 20:55:49,987 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,987 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,988 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:49,988 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:49,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:49,988 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:49,989 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-18 20:55:49,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:49,990 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-18 20:55:49,990 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:49,990 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-18 20:55:49,990 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-18 20:55:49,990 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:49,990 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:49,990 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. started... 2023-11-18 20:55:49,990 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1e6988a556cb073a80193c0ff852e78c 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-18 20:55:50,400 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205bfafc39a5a4453d9127e0b9a8a8119d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205bfafc39a5a4453d9127e0b9a8a8119d 2023-11-18 20:55:50,805 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/0af6ebf379eb45cb93eedd30e59c67ce 2023-11-18 20:55:50,809 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/0af6ebf379eb45cb93eedd30e59c67ce as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce 2023-11-18 20:55:50,812 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce, entries=1, sequenceid=41, filesize=4.9 K 2023-11-18 20:55:50,813 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1e6988a556cb073a80193c0ff852e78c in 823ms, sequenceid=41, compaction requested=true 2023-11-18 20:55:50,813 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:50,813 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-18 20:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-18 20:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-18 20:55:50,813 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-18 20:55:50,814 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,814 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:50,815 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,815 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:50,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:50,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-18 20:55:50,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1304e00d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:50,816 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-18 20:55:50,816 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,818 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,818 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-18 20:55:50,818 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-18 20:55:50,818 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:50,818 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,818 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-18 20:55:50,820 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,820 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-18 20:55:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:50,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:50,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:50,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:50,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-18 20:55:50,822 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-18 20:55:50,822 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:50,822 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:50,822 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,822 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:50,824 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,824 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:50,824 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:50,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,825 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:50,826 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-18 20:55:50,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:50,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:50,828 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:50,828 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:50,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-18 20:55:50,829 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:50,829 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,829 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:50,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:50,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:50,829 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,829 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,929 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:50,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:50,931 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-18 20:55:50,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:55:50,934 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:55:50,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:55:50,935 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341550935 2023-11-18 20:55:50,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-18 20:55:50,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-18 20:55:50,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:50,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x37babe46 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:55:50,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@295836c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:55:50,943 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:51,769 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038651392ca19b4222a16f60f95735dc3b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601038651392ca19b4222a16f60f95735dc3b 2023-11-18 20:55:51,770 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:51,782 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:55:51,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:55:51,789 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:55:51,790 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:55:51,798 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/31b3cfc78bff4221a8ebc730627d4588 first=Optional[r5] last=Optional[r6] 2023-11-18 20:55:51,799 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/31b3cfc78bff4221a8ebc730627d4588}] 2023-11-18 20:55:51,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/31b3cfc78bff4221a8ebc730627d4588 for inclusion in 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-18 20:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:55:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:51,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/31b3cfc78bff4221a8ebc730627d4588 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j1i49eutnpto5smlnkucp3nm6m5i33pelkruu6r10j326a1ru5h0a61ign37e8mg/family1/31b3cfc78bff4221a8ebc730627d4588 2023-11-18 20:55:51,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j1i49eutnpto5smlnkucp3nm6m5i33pelkruu6r10j326a1ru5h0a61ign37e8mg/family1/31b3cfc78bff4221a8ebc730627d4588 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_ 2023-11-18 20:55:51,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j1i49eutnpto5smlnkucp3nm6m5i33pelkruu6r10j326a1ru5h0a61ign37e8mg/family1/31b3cfc78bff4221a8ebc730627d4588 into 1e6988a556cb073a80193c0ff852e78c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_ - updating store file list. 2023-11-18 20:55:51,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_ into 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:51,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j1i49eutnpto5smlnkucp3nm6m5i33pelkruu6r10j326a1ru5h0a61ign37e8mg/family1/31b3cfc78bff4221a8ebc730627d4588 into 1e6988a556cb073a80193c0ff852e78c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_) 2023-11-18 20:55:51,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__j1i49eutnpto5smlnkucp3nm6m5i33pelkruu6r10j326a1ru5h0a61ign37e8mg/family1/31b3cfc78bff4221a8ebc730627d4588 2023-11-18 20:55:51,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-18 20:55:51,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-18 20:55:51,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(1912): 1e6988a556cb073a80193c0ff852e78c/family1 is initiating minor compaction 2023-11-18 20:55:51,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3f38ea6c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:51,823 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1e6988a556cb073a80193c0ff852e78c/family1 in testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:51,823 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp, totalSize=49.7 K 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 857c624b06f14ba8bc82336ea64b730d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 9b6473cbbd964ecd9c57a834ea6bb874, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting f9a7c9e963e546fba80d3f16e88d641d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting fd5d98450e8a40378ae8981598f34741, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 04ea24b50b794da698bc3bc4402e3d8e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 2d18e3bbf85d46608e8d35c0f872078a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-18 20:55:51,823 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 60f4f72dbf0a4373b1e192459531e170, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-18 20:55:51,824 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 7b213ef73a96404d9a0591d44081ba73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-18 20:55:51,824 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 0af6ebf379eb45cb93eedd30e59c67ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-18 20:55:51,824 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-18 20:55:51,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:51,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:51,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fd2a35cbc2d4b0abf2ddec56478493e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601013fd2a35cbc2d4b0abf2ddec56478493e 2023-11-18 20:55:51,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d5c8fef7e6014bfea99851fb4fd6a1dc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d5c8fef7e6014bfea99851fb4fd6a1dc 2023-11-18 20:55:51,830 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-18 20:55:51,830 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-18 20:55:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:51,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:51,862 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1e6988a556cb073a80193c0ff852e78c#family1#compaction#166 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:52,679 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/8d5c364d9b2c416886ad58772db6f6d7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8d5c364d9b2c416886ad58772db6f6d7 2023-11-18 20:55:52,683 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1e6988a556cb073a80193c0ff852e78c/family1 of 1e6988a556cb073a80193c0ff852e78c into 8d5c364d9b2c416886ad58772db6f6d7(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:52,683 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:52,683 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1700340951823; duration=0sec 2023-11-18 20:55:52,684 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:52,684 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f12788392e524f9494278d298f1be847 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231f12788392e524f9494278d298f1be847 2023-11-18 20:55:52,685 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:52,707 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8a18a595f8f343baac5daae4711c951f first=Optional[r1] last=Optional[r4] 2023-11-18 20:55:52,708 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8a18a595f8f343baac5daae4711c951f}] 2023-11-18 20:55:52,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8a18a595f8f343baac5daae4711c951f for inclusion in 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:52,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-18 20:55:52,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:55:52,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:52,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/8a18a595f8f343baac5daae4711c951f to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__82647top21ec0v7bjivrbe0ahaqdccr9l78797k1k353fdb0m31kl0l26htt1vn9/family1/8a18a595f8f343baac5daae4711c951f 2023-11-18 20:55:52,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__82647top21ec0v7bjivrbe0ahaqdccr9l78797k1k353fdb0m31kl0l26htt1vn9/family1/8a18a595f8f343baac5daae4711c951f as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_ 2023-11-18 20:55:52,718 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__82647top21ec0v7bjivrbe0ahaqdccr9l78797k1k353fdb0m31kl0l26htt1vn9/family1/8a18a595f8f343baac5daae4711c951f into 1e6988a556cb073a80193c0ff852e78c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_ - updating store file list. 2023-11-18 20:55:52,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_ into 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:52,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__82647top21ec0v7bjivrbe0ahaqdccr9l78797k1k353fdb0m31kl0l26htt1vn9/family1/8a18a595f8f343baac5daae4711c951f into 1e6988a556cb073a80193c0ff852e78c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_) 2023-11-18 20:55:52,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__82647top21ec0v7bjivrbe0ahaqdccr9l78797k1k353fdb0m31kl0l26htt1vn9/family1/8a18a595f8f343baac5daae4711c951f 2023-11-18 20:55:52,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-18 20:55:52,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-18 20:55:52,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(1912): 1e6988a556cb073a80193c0ff852e78c/family1 is initiating minor compaction (all files) 2023-11-18 20:55:52,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9b32ed4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:52,723 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1e6988a556cb073a80193c0ff852e78c/family1 in testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:55:52,723 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8d5c364d9b2c416886ad58772db6f6d7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp, totalSize=178.1 K 2023-11-18 20:55:52,724 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 71d36ec5b69b48f898f33983335a4d3d, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878826804 2023-11-18 20:55:52,724 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 8d5c364d9b2c416886ad58772db6f6d7, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621226804 2023-11-18 20:55:52,724 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] compactions.Compactor(207): Compacting 0e268b3312c54e2db23999bbe5983a68_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965226804 2023-11-18 20:55:52,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:52,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:52,727 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010ed4df412f574558806542367cd02d56 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512010ed4df412f574558806542367cd02d56 2023-11-18 20:55:52,729 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205faf270b6efa948ad99f812b3673e3a03 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205faf270b6efa948ad99f812b3673e3a03 2023-11-18 20:55:52,730 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f68b8835b70f4aaab15855470c812321 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f68b8835b70f4aaab15855470c812321 2023-11-18 20:55:52,731 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231842b922d37904beca734b970e12a4662 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231842b922d37904beca734b970e12a4662 2023-11-18 20:55:52,731 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-18 20:55:52,731 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-18 20:55:52,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:52,731 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:52,740 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1e6988a556cb073a80193c0ff852e78c#family1#compaction#167 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:55:52,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_] to archive 2023-11-18 20:55:52,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:52,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/857c624b06f14ba8bc82336ea64b730d 2023-11-18 20:55:52,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/9b6473cbbd964ecd9c57a834ea6bb874 2023-11-18 20:55:52,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/f9a7c9e963e546fba80d3f16e88d641d 2023-11-18 20:55:52,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/fd5d98450e8a40378ae8981598f34741 2023-11-18 20:55:52,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/04ea24b50b794da698bc3bc4402e3d8e 2023-11-18 20:55:52,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/2d18e3bbf85d46608e8d35c0f872078a 2023-11-18 20:55:52,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/60f4f72dbf0a4373b1e192459531e170 2023-11-18 20:55:52,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/7b213ef73a96404d9a0591d44081ba73 2023-11-18 20:55:52,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0af6ebf379eb45cb93eedd30e59c67ce 2023-11-18 20:55:52,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8e1a658f7eec4123984d095c9f9b1fc2_SeqId_44_ 2023-11-18 20:55:52,784 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130245264dece3342b49eeb2382badd0596 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130245264dece3342b49eeb2382badd0596 2023-11-18 20:55:52,784 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:52,809 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b95176d5b314556ac10512a3bc599d8 first=Optional[r00] last=Optional[r8] 2023-11-18 20:55:52,810 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b95176d5b314556ac10512a3bc599d8}] 2023-11-18 20:55:52,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b95176d5b314556ac10512a3bc599d8 for inclusion in 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:52,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-18 20:55:52,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last= 2023-11-18 20:55:52,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:52,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b95176d5b314556ac10512a3bc599d8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16231qmljul0qr1h7sbq5earvtffsvlh8dd20hs71fqi5vgl68jbdk73u5bvssu/family1/9b95176d5b314556ac10512a3bc599d8 2023-11-18 20:55:52,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16231qmljul0qr1h7sbq5earvtffsvlh8dd20hs71fqi5vgl68jbdk73u5bvssu/family1/9b95176d5b314556ac10512a3bc599d8 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/5d146de0df694b328d405a5049a83b2b_SeqId_49_ 2023-11-18 20:55:52,819 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16231qmljul0qr1h7sbq5earvtffsvlh8dd20hs71fqi5vgl68jbdk73u5bvssu/family1/9b95176d5b314556ac10512a3bc599d8 into 1e6988a556cb073a80193c0ff852e78c/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/5d146de0df694b328d405a5049a83b2b_SeqId_49_ - updating store file list. 2023-11-18 20:55:52,821 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/5d146de0df694b328d405a5049a83b2b_SeqId_49_ into 1e6988a556cb073a80193c0ff852e78c/family1 2023-11-18 20:55:52,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16231qmljul0qr1h7sbq5earvtffsvlh8dd20hs71fqi5vgl68jbdk73u5bvssu/family1/9b95176d5b314556ac10512a3bc599d8 into 1e6988a556cb073a80193c0ff852e78c/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/5d146de0df694b328d405a5049a83b2b_SeqId_49_) 2023-11-18 20:55:52,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__i16231qmljul0qr1h7sbq5earvtffsvlh8dd20hs71fqi5vgl68jbdk73u5bvssu/family1/9b95176d5b314556ac10512a3bc599d8 2023-11-18 20:55:52,823 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:52,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:52,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205bfafc39a5a4453d9127e0b9a8a8119d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205bfafc39a5a4453d9127e0b9a8a8119d 2023-11-18 20:55:52,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d9f31f94a0124ae7bc0d806f43cff859 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128d9f31f94a0124ae7bc0d806f43cff859 2023-11-18 20:55:52,827 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305dbafe2676ea4d6bba717addc98c5ffe to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511305dbafe2676ea4d6bba717addc98c5ffe 2023-11-18 20:55:52,827 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-18 20:55:52,827 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-18 20:55:52,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:52,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:52,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-18 20:55:52,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-18 20:55:52,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:55:52,829 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-18 20:55:52,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8970 sec 2023-11-18 20:55:53,027 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=264 (was 250) - Thread LEAK? -, OpenFileDescriptor=694 (was 649) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=129 (was 137), ProcessCount=171 (was 171), AvailableMemoryMB=20762 (was 20772) 2023-11-18 20:55:53,039 INFO [Listener at localhost/41997] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=264, OpenFileDescriptor=694, MaxFileDescriptor=60000, SystemLoadAverage=129, ProcessCount=171, AvailableMemoryMB=20761 2023-11-18 20:55:53,057 DEBUG [Listener at localhost/41997] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-18 20:55:53,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x91\xE4\xFF\xC8\xB1\x814\xC00\x98\x82M\x0FIp\xE3"\x10\xDA\x1F_\x9D\xED\xEE\xC9\xF6\xBB\xB0n\x05\xB2w\xEB\x16*\x10j\xC4\x80\x06\xD6\xD252Y\xDE\xA4C\x16\xA0\xD0\x962\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-18 20:55:53,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-18 20:55:53,112 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-18 20:55:53,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-18 20:55:53,113 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-18 20:55:53,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346 empty. 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf empty. 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a empty. 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf 2023-11-18 20:55:53,115 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:53,116 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-18 20:55:53,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:53,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:53,522 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-18 20:55:53,523 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 834ec4f43578b93d1d3339afc2c5c47a, NAME => 'testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x91\xE4\xFF\xC8\xB1\x814\xC00\x98\x82M\x0FIp\xE3"\x10\xDA\x1F_\x9D\xED\xEE\xC9\xF6\xBB\xB0n\x05\xB2w\xEB\x16*\x10j\xC4\x80\x06\xD6\xD252Y\xDE\xA4C\x16\xA0\xD0\x962\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:53,524 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f5d9662146329e0b78b585133fa5346, NAME => 'testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x91\xE4\xFF\xC8\xB1\x814\xC00\x98\x82M\x0FIp\xE3"\x10\xDA\x1F_\x9D\xED\xEE\xC9\xF6\xBB\xB0n\x05\xB2w\xEB\x16*\x10j\xC4\x80\x06\xD6\xD252Y\xDE\xA4C\x16\xA0\xD0\x962\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:53,524 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6729021eef199c96031f799daa3377bf, NAME => 'testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x91\xE4\xFF\xC8\xB1\x814\xC00\x98\x82M\x0FIp\xE3"\x10\xDA\x1F_\x9D\xED\xEE\xC9\xF6\xBB\xB0n\x05\xB2w\xEB\x16*\x10j\xC4\x80\x06\xD6\xD252Y\xDE\xA4C\x16\xA0\xD0\x962\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/.tmp 2023-11-18 20:55:53,588 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/.tmp/family1/dbf2badb320c45d087f1ad3d3e02da3b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/dbf2badb320c45d087f1ad3d3e02da3b 2023-11-18 20:55:53,592 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1e6988a556cb073a80193c0ff852e78c/family1 of 1e6988a556cb073a80193c0ff852e78c into dbf2badb320c45d087f1ad3d3e02da3b(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:55:53,592 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:55:53,592 INFO [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1700340952723; duration=0sec 2023-11-18 20:55:53,592 DEBUG [RS:0;jenkins-hbase4:32871-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-18 20:55:53,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8d5c364d9b2c416886ad58772db6f6d7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_] to archive 2023-11-18 20:55:53,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:55:53,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/71d36ec5b69b48f898f33983335a4d3d 2023-11-18 20:55:53,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8d5c364d9b2c416886ad58772db6f6d7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/8d5c364d9b2c416886ad58772db6f6d7 2023-11-18 20:55:53,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_ to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/family1/0e268b3312c54e2db23999bbe5983a68_SeqId_47_ 2023-11-18 20:55:53,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:53,936 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:53,936 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 834ec4f43578b93d1d3339afc2c5c47a, disabling compactions & flushes 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 2f5d9662146329e0b78b585133fa5346, disabling compactions & flushes 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 6729021eef199c96031f799daa3377bf, disabling compactions & flushes 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. after waiting 0 ms 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. after waiting 0 ms 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. after waiting 0 ms 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:53,937 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:53,938 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:55:53,937 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:55:53,940 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-18 20:55:53,940 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340953940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340953940"}]},"ts":"1700340953940"} 2023-11-18 20:55:53,941 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700340953940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340953940"}]},"ts":"1700340953940"} 2023-11-18 20:55:53,941 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340953940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1700340953940"}]},"ts":"1700340953940"} 2023-11-18 20:55:53,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-18 20:55:53,943 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-18 20:55:53,943 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340953943"}]},"ts":"1700340953943"} 2023-11-18 20:55:53,944 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-18 20:55:53,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2f5d9662146329e0b78b585133fa5346, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6729021eef199c96031f799daa3377bf, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=834ec4f43578b93d1d3339afc2c5c47a, ASSIGN}] 2023-11-18 20:55:53,948 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6729021eef199c96031f799daa3377bf, ASSIGN 2023-11-18 20:55:53,948 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2f5d9662146329e0b78b585133fa5346, ASSIGN 2023-11-18 20:55:53,948 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=834ec4f43578b93d1d3339afc2c5c47a, ASSIGN 2023-11-18 20:55:53,949 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6729021eef199c96031f799daa3377bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:53,949 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2f5d9662146329e0b78b585133fa5346, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:53,949 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=834ec4f43578b93d1d3339afc2c5c47a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32871,1700340802897; forceNewPlan=false, retain=false 2023-11-18 20:55:54,101 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=834ec4f43578b93d1d3339afc2c5c47a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,101 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=2f5d9662146329e0b78b585133fa5346, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,101 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=6729021eef199c96031f799daa3377bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,101 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340954101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340954101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340954101"}]},"ts":"1700340954101"} 2023-11-18 20:55:54,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700340954101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340954101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340954101"}]},"ts":"1700340954101"} 2023-11-18 20:55:54,101 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340954101"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1700340954101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1700340954101"}]},"ts":"1700340954101"} 2023-11-18 20:55:54,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 834ec4f43578b93d1d3339afc2c5c47a, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:54,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 2f5d9662146329e0b78b585133fa5346, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:54,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 6729021eef199c96031f799daa3377bf, server=jenkins-hbase4.apache.org,32871,1700340802897}] 2023-11-18 20:55:54,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:54,254 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6729021eef199c96031f799daa3377bf, NAME => 'testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.', STARTKEY => '1', ENDKEY => '2'} 2023-11-18 20:55:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,278 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,280 DEBUG [StoreOpener-6729021eef199c96031f799daa3377bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1 2023-11-18 20:55:54,280 DEBUG [StoreOpener-6729021eef199c96031f799daa3377bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1 2023-11-18 20:55:54,280 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6729021eef199c96031f799daa3377bf columnFamilyName family1 2023-11-18 20:55:54,281 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] regionserver.HStore(310): Store=6729021eef199c96031f799daa3377bf/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,282 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,283 DEBUG [StoreOpener-6729021eef199c96031f799daa3377bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2 2023-11-18 20:55:54,283 DEBUG [StoreOpener-6729021eef199c96031f799daa3377bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2 2023-11-18 20:55:54,283 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6729021eef199c96031f799daa3377bf columnFamilyName family2 2023-11-18 20:55:54,284 INFO [StoreOpener-6729021eef199c96031f799daa3377bf-1] regionserver.HStore(310): Store=6729021eef199c96031f799daa3377bf/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:54,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6729021eef199c96031f799daa3377bf 2023-11-18 20:55:54,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:54,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6729021eef199c96031f799daa3377bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70735763, jitterRate=0.05404500663280487}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:54,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:55:54,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf., pid=122, masterSystemTime=1700340954254 2023-11-18 20:55:54,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:54,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:54,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:54,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f5d9662146329e0b78b585133fa5346, NAME => 'testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.', STARTKEY => '', ENDKEY => '1'} 2023-11-18 20:55:54,292 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=6729021eef199c96031f799daa3377bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:54,293 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1700340954292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340954292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340954292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340954292"}]},"ts":"1700340954292"} 2023-11-18 20:55:54,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-11-18 20:55:54,295 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 6729021eef199c96031f799daa3377bf, server=jenkins-hbase4.apache.org,32871,1700340802897 in 190 msec 2023-11-18 20:55:54,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6729021eef199c96031f799daa3377bf, ASSIGN in 348 msec 2023-11-18 20:55:54,313 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,314 DEBUG [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1 2023-11-18 20:55:54,314 DEBUG [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1 2023-11-18 20:55:54,315 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f5d9662146329e0b78b585133fa5346 columnFamilyName family1 2023-11-18 20:55:54,316 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] regionserver.HStore(310): Store=2f5d9662146329e0b78b585133fa5346/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,316 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,317 DEBUG [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2 2023-11-18 20:55:54,317 DEBUG [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2 2023-11-18 20:55:54,317 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f5d9662146329e0b78b585133fa5346 columnFamilyName family2 2023-11-18 20:55:54,318 INFO [StoreOpener-2f5d9662146329e0b78b585133fa5346-1] regionserver.HStore(310): Store=2f5d9662146329e0b78b585133fa5346/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:54,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:55:54,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:54,323 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f5d9662146329e0b78b585133fa5346; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70037658, jitterRate=0.04364243149757385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:54,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:55:54,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346., pid=121, masterSystemTime=1700340954254 2023-11-18 20:55:54,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:54,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:54,325 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 834ec4f43578b93d1d3339afc2c5c47a, NAME => 'testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.', STARTKEY => '2', ENDKEY => ''} 2023-11-18 20:55:54,326 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=2f5d9662146329e0b78b585133fa5346, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-18 20:55:54,326 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340954326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340954326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340954326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340954326"}]},"ts":"1700340954326"} 2023-11-18 20:55:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-11-18 20:55:54,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 2f5d9662146329e0b78b585133fa5346, server=jenkins-hbase4.apache.org,32871,1700340802897 in 224 msec 2023-11-18 20:55:54,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2f5d9662146329e0b78b585133fa5346, ASSIGN in 382 msec 2023-11-18 20:55:54,346 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,348 DEBUG [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1 2023-11-18 20:55:54,348 DEBUG [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1 2023-11-18 20:55:54,348 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 834ec4f43578b93d1d3339afc2c5c47a columnFamilyName family1 2023-11-18 20:55:54,349 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] regionserver.HStore(310): Store=834ec4f43578b93d1d3339afc2c5c47a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,349 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,350 DEBUG [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2 2023-11-18 20:55:54,350 DEBUG [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2 2023-11-18 20:55:54,350 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 834ec4f43578b93d1d3339afc2c5c47a columnFamilyName family2 2023-11-18 20:55:54,351 INFO [StoreOpener-834ec4f43578b93d1d3339afc2c5c47a-1] regionserver.HStore(310): Store=834ec4f43578b93d1d3339afc2c5c47a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-18 20:55:54,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-18 20:55:54,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:55:54,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-18 20:55:54,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 834ec4f43578b93d1d3339afc2c5c47a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61925301, jitterRate=-0.07724110782146454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-18 20:55:54,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:54,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a., pid=120, masterSystemTime=1700340954254 2023-11-18 20:55:54,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:54,357 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:54,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=834ec4f43578b93d1d3339afc2c5c47a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:54,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1700340954357"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1700340954357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1700340954357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1700340954357"}]},"ts":"1700340954357"} 2023-11-18 20:55:54,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-11-18 20:55:54,360 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 834ec4f43578b93d1d3339afc2c5c47a, server=jenkins-hbase4.apache.org,32871,1700340802897 in 256 msec 2023-11-18 20:55:54,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-18 20:55:54,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=834ec4f43578b93d1d3339afc2c5c47a, ASSIGN in 413 msec 2023-11-18 20:55:54,361 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-18 20:55:54,361 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1700340954361"}]},"ts":"1700340954361"} 2023-11-18 20:55:54,362 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-18 20:55:54,365 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-18 20:55:54,366 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2550 sec 2023-11-18 20:55:55,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-18 20:55:55,218 INFO [Listener at localhost/41997] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-18 20:55:55,223 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:55,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:55,224 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:55,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:55,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 20:55:55,228 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 20:55:55,228 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:55,228 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 20:55:55,228 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 20:55:55,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:55,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:55,230 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:55,230 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:55,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:55,230 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:55,230 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:55,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:55,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:55,231 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 20:55:55,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 20:55:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 20:55:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. started... 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. started... 2023-11-18 20:55:55,233 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2f5d9662146329e0b78b585133fa5346 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:55,232 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. started... 2023-11-18 20:55:55,234 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 834ec4f43578b93d1d3339afc2c5c47a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:55,234 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6729021eef199c96031f799daa3377bf 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-18 20:55:55,278 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311183d82a0e3f3114cabb1a7035c1d56ae7d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183d82a0e3f3114cabb1a7035c1d56ae7d 2023-11-18 20:55:55,287 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118471c0769c03a453c81be12c1f92e1829 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118471c0769c03a453c81be12c1f92e1829 2023-11-18 20:55:55,390 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-18 20:55:55,677 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111887d32d0ee49b4dcea673a7bfe4363ca1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111887d32d0ee49b4dcea673a7bfe4363ca1 2023-11-18 20:55:55,692 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d 2023-11-18 20:55:55,701 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/bf124862065f457dafad301fc7ae60c7 2023-11-18 20:55:55,724 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118a50be296bb144693ae8f4ce4d40b5110 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118a50be296bb144693ae8f4ce4d40b5110 2023-11-18 20:55:55,737 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311180c56587178e34bfb8f6e7d2b1e62dc0b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311180c56587178e34bfb8f6e7d2b1e62dc0b 2023-11-18 20:55:56,092 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/961f938ccde94216992aa854f9aa65d1 2023-11-18 20:55:56,129 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/15762a4b93fc4a1a827adc986de4a113 2023-11-18 20:55:56,133 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d 2023-11-18 20:55:56,141 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/d29d180a2f5849c594c7650ed8e80246 2023-11-18 20:55:56,145 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/bf124862065f457dafad301fc7ae60c7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7 2023-11-18 20:55:56,158 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311182ed4ab27b76d459383586ce76b953490 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311182ed4ab27b76d459383586ce76b953490 2023-11-18 20:55:56,170 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/a41bd63704d74c858ad89cade885e8e7 2023-11-18 20:55:56,170 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 20:55:56,171 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/d29d180a2f5849c594c7650ed8e80246 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246 2023-11-18 20:55:56,172 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 20:55:56,173 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/15762a4b93fc4a1a827adc986de4a113 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113 2023-11-18 20:55:56,177 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/961f938ccde94216992aa854f9aa65d1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1 2023-11-18 20:55:56,177 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:56,178 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:56,178 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 834ec4f43578b93d1d3339afc2c5c47a in 945ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:56,179 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:56,179 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:56,179 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:56,179 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6729021eef199c96031f799daa3377bf in 945ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:55:56,180 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:56,180 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:56,203 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1, entries=4, sequenceid=5, filesize=5.5 K 2023-11-18 20:55:56,204 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/a41bd63704d74c858ad89cade885e8e7 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7 2023-11-18 20:55:56,208 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7, entries=2, sequenceid=5, filesize=5.1 K 2023-11-18 20:55:56,208 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2f5d9662146329e0b78b585133fa5346 in 975ms, sequenceid=5, compaction requested=false 2023-11-18 20:55:56,208 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:55:56,209 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:56,209 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:56,209 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:56,209 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,209 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 20:55:56,209 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 20:55:56,211 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,211 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:56,211 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,211 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 20:55:56,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43543f47[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:56,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 20:55:56,213 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,214 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 20:55:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 20:55:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:56,214 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,214 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:56,216 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 20:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:56,216 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 20:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:56,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:56,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 20:55:56,218 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 20:55:56,219 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:56,219 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:56,219 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 20:55:56,219 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:56,225 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,225 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,225 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:56,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:56,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:56,226 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,227 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,229 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:56,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 20:55:56,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:56,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:56,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:56,229 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,230 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:56,230 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:56,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:56,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:56,330 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:56,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:56,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:56,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:56,332 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:56,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:56,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:56,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 20:55:56,338 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 20:55:56,338 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:56,338 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 20:55:56,338 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 20:55:56,338 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,338 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:56,340 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:56,340 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:56,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:56,340 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:56,340 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:56,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:56,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:56,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 20:55:56,342 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 20:55:56,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 20:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 20:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:56,342 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. started... 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. started... 2023-11-18 20:55:56,342 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. started... 2023-11-18 20:55:56,343 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2f5d9662146329e0b78b585133fa5346 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:56,343 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6729021eef199c96031f799daa3377bf 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:56,343 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 834ec4f43578b93d1d3339afc2c5c47a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-18 20:55:56,790 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311184605c7d84b90480d8d920e78854d0b38 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311184605c7d84b90480d8d920e78854d0b38 2023-11-18 20:55:56,797 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111834c384250d5b41249e236a7a03cd1320 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111834c384250d5b41249e236a7a03cd1320 2023-11-18 20:55:56,800 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311188d28a93ac030451ba33f00e6ffa16e33 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188d28a93ac030451ba33f00e6ffa16e33 2023-11-18 20:55:56,809 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/1b04a757899d47cc9f16916e63e3fe8b 2023-11-18 20:55:56,841 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118f24de22dad074804a10510aeda7bd6a0 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231118f24de22dad074804a10510aeda7bd6a0 2023-11-18 20:55:57,222 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/1b6cbc4e57594710a41dd62c4b17f8d3 2023-11-18 20:55:57,230 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/c1da4c711b174b278ff448af5b91b411 2023-11-18 20:55:57,246 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/dfa0e62ac1f148f190712930fff418fe 2023-11-18 20:55:57,249 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/1b04a757899d47cc9f16916e63e3fe8b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b 2023-11-18 20:55:57,272 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 20:55:57,273 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/dfa0e62ac1f148f190712930fff418fe as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe 2023-11-18 20:55:57,276 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:57,277 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 834ec4f43578b93d1d3339afc2c5c47a in 934ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:57,277 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:57,277 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:57,277 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:57,665 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118924030653ba54ad6b35f40e1ff13d63a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118924030653ba54ad6b35f40e1ff13d63a 2023-11-18 20:55:57,671 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118e3cc821b04734d44bd0415fe97749477 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118e3cc821b04734d44bd0415fe97749477 2023-11-18 20:55:57,671 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/ccf492a463cf419aa3c4939192bd4cef 2023-11-18 20:55:57,676 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/a89e2cb3ef554f86b58ee859b3c334dc 2023-11-18 20:55:57,676 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/1b6cbc4e57594710a41dd62c4b17f8d3 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3 2023-11-18 20:55:57,680 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/c1da4c711b174b278ff448af5b91b411 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411 2023-11-18 20:55:57,700 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 20:55:57,701 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/ccf492a463cf419aa3c4939192bd4cef as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef 2023-11-18 20:55:57,704 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:57,705 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2f5d9662146329e0b78b585133fa5346 in 1363ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:57,705 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:55:57,705 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:57,705 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:57,715 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411, entries=4, sequenceid=9, filesize=5.5 K 2023-11-18 20:55:57,716 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/a89e2cb3ef554f86b58ee859b3c334dc as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc 2023-11-18 20:55:57,719 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc, entries=2, sequenceid=9, filesize=5.1 K 2023-11-18 20:55:57,720 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6729021eef199c96031f799daa3377bf in 1378ms, sequenceid=9, compaction requested=false 2023-11-18 20:55:57,720 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:55:57,720 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 20:55:57,720 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 20:55:57,722 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,722 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:57,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,723 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:57,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 20:55:57,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1749cc1d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:57,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 20:55:57,724 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,727 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 20:55:57,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 20:55:57,727 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:57,727 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,727 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:57,728 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 20:55:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:57,728 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 20:55:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:57,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:57,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:57,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 20:55:57,731 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 20:55:57,731 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:57,731 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:57,731 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 20:55:57,731 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:57,733 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,733 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:57,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,733 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:57,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:57,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:57,733 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:57,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,735 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:57,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:57,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:57,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,737 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:57,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:57,737 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:57,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:57,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:57,738 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:57,738 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:57,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:57,838 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:57,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:57,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:57,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:57,840 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:57,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:57,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:57,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 20:55:57,844 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 20:55:57,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:57,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 20:55:57,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 20:55:57,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,844 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:57,846 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,846 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:57,847 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:57,847 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:57,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:57,848 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 20:55:57,848 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 20:55:57,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 20:55:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 20:55:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:57,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. started... 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. started... 2023-11-18 20:55:57,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. started... 2023-11-18 20:55:57,849 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2f5d9662146329e0b78b585133fa5346 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:57,849 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 834ec4f43578b93d1d3339afc2c5c47a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:57,849 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6729021eef199c96031f799daa3377bf 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-18 20:55:57,895 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111833fa3c63fa3246d3b4d99a4c2c9ee8fb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111833fa3c63fa3246d3b4d99a4c2c9ee8fb 2023-11-18 20:55:57,908 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118307ec3ab197545e285fc2ae0bb254846 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118307ec3ab197545e285fc2ae0bb254846 2023-11-18 20:55:57,908 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311183dc0ea1e947f46f48dc46b23c87bd9c2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183dc0ea1e947f46f48dc46b23c87bd9c2 2023-11-18 20:55:58,314 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/4fd08ab5b49649e6971c2945f174557c 2023-11-18 20:55:58,324 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/607896e4d27b452ba41252d950f93823 2023-11-18 20:55:58,330 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/b9a981b200af484a9e35ef269c61bc92 2023-11-18 20:55:58,357 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118e23ca68ba78e4899837e6c452f9918f8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231118e23ca68ba78e4899837e6c452f9918f8 2023-11-18 20:55:58,365 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/f99a325c879c4dea9c384569d15525fa 2023-11-18 20:55:58,369 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ba5bf4e6acaf41e98e10f8ccc4eca2a8 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118ba5bf4e6acaf41e98e10f8ccc4eca2a8 2023-11-18 20:55:58,371 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/4fd08ab5b49649e6971c2945f174557c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c 2023-11-18 20:55:58,383 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/65437c6b852d4d28aed06a06191e6056 2023-11-18 20:55:58,385 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118150a27d79f3c4aa08bdc788287955abf to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118150a27d79f3c4aa08bdc788287955abf 2023-11-18 20:55:58,388 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/607896e4d27b452ba41252d950f93823 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823 2023-11-18 20:55:58,406 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 20:55:58,407 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/f99a325c879c4dea9c384569d15525fa as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa 2023-11-18 20:55:58,410 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:58,411 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 834ec4f43578b93d1d3339afc2c5c47a in 562ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:58,411 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:58,411 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:58,411 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:58,412 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 20:55:58,412 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/65437c6b852d4d28aed06a06191e6056 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056 2023-11-18 20:55:58,415 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:58,416 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2f5d9662146329e0b78b585133fa5346 in 567ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:58,416 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:55:58,416 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:58,416 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:55:58,794 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/4e1862aac9a347daaa37c7f452956538 2023-11-18 20:55:58,798 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/b9a981b200af484a9e35ef269c61bc92 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92 2023-11-18 20:55:58,821 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92, entries=4, sequenceid=13, filesize=5.5 K 2023-11-18 20:55:58,821 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/4e1862aac9a347daaa37c7f452956538 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538 2023-11-18 20:55:58,825 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538, entries=2, sequenceid=13, filesize=5.1 K 2023-11-18 20:55:58,825 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6729021eef199c96031f799daa3377bf in 976ms, sequenceid=13, compaction requested=true 2023-11-18 20:55:58,825 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:55:58,825 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:58,825 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:55:58,825 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:55:58,825 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,826 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 20:55:58,826 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 20:55:58,827 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,827 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:58,827 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:58,828 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:55:58,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:58,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:58,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 20:55:58,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cc54060[Count = 0] remaining members to acquire global barrier 2023-11-18 20:55:58,829 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 20:55:58,829 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,830 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 20:55:58,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 20:55:58,830 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:55:58,830 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,830 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:55:58,831 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 20:55:58,831 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,831 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,831 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 20:55:58,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:55:58,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 20:55:58,834 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 20:55:58,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:55:58,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:55:58,834 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 20:55:58,834 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:55:58,837 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,837 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,837 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:55:58,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:58,837 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:55:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:55:58,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,839 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:55:58,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:55:58,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,841 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:58,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 20:55:58,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:55:58,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:58,841 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:55:58,842 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,842 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 20:55:58,842 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:55:58,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:55:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:55:58,942 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:55:58,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:55:58,943 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:58,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:58,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-18 20:55:58,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:55:58,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 20:55:58,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 20:55:58,948 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 20:55:58,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:58,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 20:55:58,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 20:55:58,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,948 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:58,949 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,949 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:55:58,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:55:58,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:55:58,950 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:55:58,950 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:55:58,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:58,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:55:58,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:55:58,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:55:58,951 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 20:55:58,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 20:55:58,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 20:55:58,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 20:55:58,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:55:58,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 20:55:58,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:58,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. started... 2023-11-18 20:55:58,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:55:58,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:55:58,951 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:55:58,951 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 834ec4f43578b93d1d3339afc2c5c47a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:58,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:55:58,951 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. started... 2023-11-18 20:55:58,952 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. started... 2023-11-18 20:55:58,952 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2f5d9662146329e0b78b585133fa5346 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:58,952 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6729021eef199c96031f799daa3377bf 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-18 20:55:58,998 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118f66aa9bc88bf4f0e97f06bfe3cbb4860 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118f66aa9bc88bf4f0e97f06bfe3cbb4860 2023-11-18 20:55:59,007 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311188e2c407a1f9d4b37b544336b5b9b16d7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188e2c407a1f9d4b37b544336b5b9b16d7 2023-11-18 20:55:59,026 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:55:59,026 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37babe46 to 127.0.0.1:55479 2023-11-18 20:55:59,026 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:59,028 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:55:59,028 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b5b37d7 to 127.0.0.1:55479 2023-11-18 20:55:59,028 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:55:59,408 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ae6cdfffc72f4e75847d217675f0e3fd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ae6cdfffc72f4e75847d217675f0e3fd 2023-11-18 20:55:59,411 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/4c9ed36564b6402fb5336aa7bae972e4 2023-11-18 20:55:59,438 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/630bc23a49464104a21d0c1ba729f0cd 2023-11-18 20:55:59,442 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118fd2b38bf347e4268ae01e376e8082e27 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231118fd2b38bf347e4268ae01e376e8082e27 2023-11-18 20:55:59,446 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/e843e75a429f476b9e5915c1d29f7d68 2023-11-18 20:55:59,450 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/4c9ed36564b6402fb5336aa7bae972e4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4 2023-11-18 20:55:59,484 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 20:55:59,484 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/e843e75a429f476b9e5915c1d29f7d68 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68 2023-11-18 20:55:59,487 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:55:59,488 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 834ec4f43578b93d1d3339afc2c5c47a in 537ms, sequenceid=17, compaction requested=true 2023-11-18 20:55:59,488 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:55:59,488 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:55:59,488 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:55:59,797 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-18 20:55:59,823 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/540044c87cd34753860516eaccc4b781 2023-11-18 20:55:59,869 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118171c4d22a28d4d6ea40e947d05dc9179 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118171c4d22a28d4d6ea40e947d05dc9179 2023-11-18 20:56:00,256 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118f937bd07496d457dbeb5b8ba82214c50 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118f937bd07496d457dbeb5b8ba82214c50 2023-11-18 20:56:00,273 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/1f568f14f1d3424ea8a60e50fc07272d 2023-11-18 20:56:00,277 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/630bc23a49464104a21d0c1ba729f0cd as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd 2023-11-18 20:56:00,299 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 20:56:00,300 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/1f568f14f1d3424ea8a60e50fc07272d as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d 2023-11-18 20:56:00,304 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:56:00,305 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6729021eef199c96031f799daa3377bf in 1353ms, sequenceid=17, compaction requested=true 2023-11-18 20:56:00,305 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:00,305 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:00,305 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:56:00,661 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/563d93afaa124829ae85d3b3e63d0ab4 2023-11-18 20:56:00,665 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/540044c87cd34753860516eaccc4b781 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781 2023-11-18 20:56:00,687 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781, entries=4, sequenceid=17, filesize=5.5 K 2023-11-18 20:56:00,687 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/563d93afaa124829ae85d3b3e63d0ab4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4 2023-11-18 20:56:00,691 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4, entries=2, sequenceid=17, filesize=5.1 K 2023-11-18 20:56:00,691 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2f5d9662146329e0b78b585133fa5346 in 1739ms, sequenceid=17, compaction requested=true 2023-11-18 20:56:00,691 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:00,691 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:00,691 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:56:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:56:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 20:56:00,692 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 20:56:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,693 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:00,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:00,693 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,694 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:00,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 20:56:00,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f5c57d[Count = 0] remaining members to acquire global barrier 2023-11-18 20:56:00,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 20:56:00,695 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,700 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,700 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 20:56:00,700 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 20:56:00,700 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:56:00,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,700 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:56:00,703 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 20:56:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:56:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:00,703 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 20:56:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:00,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:00,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:56:00,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 20:56:00,705 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 20:56:00,705 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:56:00,705 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:56:00,705 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 20:56:00,705 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:56:00,707 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,707 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,707 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:00,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:00,707 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:56:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:00,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,709 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:00,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:00,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:00,711 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:56:00,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 20:56:00,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:56:00,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:56:00,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:56:00,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:56:00,711 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:00,712 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:56:00,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:56:00,812 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:56:00,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:56:00,820 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:00,826 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:00,833 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:00,834 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:00,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-18 20:56:00,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-18 20:56:00,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-18 20:56:00,914 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-18 20:56:00,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:56:00,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-18 20:56:00,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-18 20:56:00,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,914 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:00,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,916 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:56:00,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:56:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:56:00,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:00,916 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-18 20:56:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:00,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-18 20:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:00,917 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-18 20:56:00,917 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-18 20:56:00,917 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-18 20:56:00,917 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-18 20:56:00,917 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-18 20:56:00,917 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-18 20:56:00,917 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:00,917 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-18 20:56:00,917 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-18 20:56:00,917 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:00,917 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. started... 2023-11-18 20:56:00,917 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. started... 2023-11-18 20:56:00,917 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:00,918 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 834ec4f43578b93d1d3339afc2c5c47a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:56:00,918 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 2f5d9662146329e0b78b585133fa5346 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:56:00,918 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. started... 2023-11-18 20:56:00,918 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 6729021eef199c96031f799daa3377bf 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-18 20:56:00,962 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/f9911fb57d244f66a39acb61d49d16cc 2023-11-18 20:56:00,986 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9911fb57d244f66a39acb61d49d16cc 2023-11-18 20:56:01,358 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/394e5e861beb4b2e91ee8a15ab48a7b2 2023-11-18 20:56:01,361 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/5e4e59c1652744d187d36d41b70073fd 2023-11-18 20:56:01,389 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 394e5e861beb4b2e91ee8a15ab48a7b2 2023-11-18 20:56:01,392 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4e59c1652744d187d36d41b70073fd 2023-11-18 20:56:01,803 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/b17517ace39846f29640659fc29c0da5 2023-11-18 20:56:01,804 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac 2023-11-18 20:56:01,805 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/2b81b711697a4c6398929d5f465740a1 2023-11-18 20:56:01,807 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b17517ace39846f29640659fc29c0da5 2023-11-18 20:56:01,808 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e92a0c88cbe4cbe8fbf0c0e6160cbac 2023-11-18 20:56:01,808 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/f9911fb57d244f66a39acb61d49d16cc as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc 2023-11-18 20:56:01,808 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b81b711697a4c6398929d5f465740a1 2023-11-18 20:56:01,809 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/394e5e861beb4b2e91ee8a15ab48a7b2 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2 2023-11-18 20:56:01,809 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/5e4e59c1652744d187d36d41b70073fd as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd 2023-11-18 20:56:01,832 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e4e59c1652744d187d36d41b70073fd 2023-11-18 20:56:01,832 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 20:56:01,833 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/2b81b711697a4c6398929d5f465740a1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1 2023-11-18 20:56:01,836 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2b81b711697a4c6398929d5f465740a1 2023-11-18 20:56:01,836 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:56:01,837 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6729021eef199c96031f799daa3377bf in 919ms, sequenceid=23, compaction requested=true 2023-11-18 20:56:01,837 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:01,837 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-18 20:56:01,842 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 394e5e861beb4b2e91ee8a15ab48a7b2 2023-11-18 20:56:01,842 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f9911fb57d244f66a39acb61d49d16cc 2023-11-18 20:56:01,843 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 20:56:01,843 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc, entries=3, sequenceid=23, filesize=5.2 K 2023-11-18 20:56:01,843 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac 2023-11-18 20:56:01,843 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/b17517ace39846f29640659fc29c0da5 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5 2023-11-18 20:56:01,847 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e92a0c88cbe4cbe8fbf0c0e6160cbac 2023-11-18 20:56:01,847 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:56:01,847 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b17517ace39846f29640659fc29c0da5 2023-11-18 20:56:01,847 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5, entries=1, sequenceid=23, filesize=5.0 K 2023-11-18 20:56:01,848 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 834ec4f43578b93d1d3339afc2c5c47a in 930ms, sequenceid=23, compaction requested=true 2023-11-18 20:56:01,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:56:01,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-18 20:56:01,848 INFO [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2f5d9662146329e0b78b585133fa5346 in 930ms, sequenceid=23, compaction requested=true 2023-11-18 20:56:01,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:01,848 DEBUG [rs(jenkins-hbase4.apache.org,32871,1700340802897)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-18 20:56:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-18 20:56:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,850 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:01,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:01,851 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,851 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-18 20:56:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:01,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:01,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32871,1700340802897' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-18 20:56:01,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ab96323[Count = 0] remaining members to acquire global barrier 2023-11-18 20:56:01,852 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-18 20:56:01,852 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,853 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-18 20:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-18 20:56:01,853 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,32871,1700340802897' in zk 2023-11-18 20:56:01,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,854 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-18 20:56:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-18 20:56:01,855 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:01,855 DEBUG [member: 'jenkins-hbase4.apache.org,32871,1700340802897' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-18 20:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:01,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,32871,1700340802897': 2023-11-18 20:56:01,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32871,1700340802897' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-18 20:56:01,858 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-18 20:56:01,858 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-18 20:56:01,858 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-18 20:56:01,858 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-18 20:56:01,858 INFO [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-18 20:56:01,861 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,861 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-18 20:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-18 20:56:01,861 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,862 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-18 20:56:01,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-18 20:56:01,864 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-18 20:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-18 20:56:01,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-18 20:56:01,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-18 20:56:01,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-18 20:56:01,867 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-18 20:56:01,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-18 20:56:01,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-18 20:56:01,867 DEBUG [(jenkins-hbase4.apache.org,44653,1700340801652)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-18 20:56:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-18 20:56:01,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-18 20:56:01,868 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-18 20:56:01,868 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-18 20:56:01,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-18 20:56:01,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-18 20:56:01,968 DEBUG [Listener at localhost/41997] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-18 20:56:01,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44653] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-18 20:56:01,970 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:01,970 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 834ec4f43578b93d1d3339afc2c5c47a/family1 is initiating major compaction (all files) 2023-11-18 20:56:01,970 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:01,970 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:01,970 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 834ec4f43578b93d1d3339afc2c5c47a/family1 in testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:01,970 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp, totalSize=27.1 K 2023-11-18 20:56:01,971 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting bf124862065f457dafad301fc7ae60c7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955224 2023-11-18 20:56:01,972 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1b04a757899d47cc9f16916e63e3fe8b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:01,972 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 4fd08ab5b49649e6971c2945f174557c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:01,972 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 4c9ed36564b6402fb5336aa7bae972e4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958944 2023-11-18 20:56:01,973 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 394e5e861beb4b2e91ee8a15ab48a7b2, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:01,983 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 834ec4f43578b93d1d3339afc2c5c47a#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:02,428 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del 2023-11-18 20:56:02,428 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del 2023-11-18 20:56:03,279 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6d782f08f2d493b8587b48cdafb2c2c 2023-11-18 20:56:03,280 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family1/c6d782f08f2d493b8587b48cdafb2c2c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/c6d782f08f2d493b8587b48cdafb2c2c 2023-11-18 20:56:03,302 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c6d782f08f2d493b8587b48cdafb2c2c 2023-11-18 20:56:03,303 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 834ec4f43578b93d1d3339afc2c5c47a/family1 of 834ec4f43578b93d1d3339afc2c5c47a into c6d782f08f2d493b8587b48cdafb2c2c(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:56:03,303 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:56:03,304 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:03,304 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 834ec4f43578b93d1d3339afc2c5c47a/family2 is initiating major compaction (all files) 2023-11-18 20:56:03,304 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:03,304 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:03,306 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 834ec4f43578b93d1d3339afc2c5c47a/family2 in testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:03,306 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp, totalSize=25.4 K 2023-11-18 20:56:03,307 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting d29d180a2f5849c594c7650ed8e80246, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955224 2023-11-18 20:56:03,307 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting dfa0e62ac1f148f190712930fff418fe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:03,308 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting f99a325c879c4dea9c384569d15525fa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:03,308 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting e843e75a429f476b9e5915c1d29f7d68, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958944 2023-11-18 20:56:03,308 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 4e92a0c88cbe4cbe8fbf0c0e6160cbac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:03,317 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 834ec4f43578b93d1d3339afc2c5c47a#family2#compaction#199 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:03,323 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311181a6c81d1dc304aa2955411c35b39db74_del 2023-11-18 20:56:03,323 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311181a6c81d1dc304aa2955411c35b39db74_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311181a6c81d1dc304aa2955411c35b39db74_del 2023-11-18 20:56:03,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2] to archive 2023-11-18 20:56:03,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:03,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/bf124862065f457dafad301fc7ae60c7 2023-11-18 20:56:03,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/1b04a757899d47cc9f16916e63e3fe8b 2023-11-18 20:56:03,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4fd08ab5b49649e6971c2945f174557c 2023-11-18 20:56:03,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/4c9ed36564b6402fb5336aa7bae972e4 2023-11-18 20:56:03,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/394e5e861beb4b2e91ee8a15ab48a7b2 2023-11-18 20:56:03,737 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 812743069c2647208a13f8ac48e906d4 2023-11-18 20:56:03,738 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/.tmp/family2/812743069c2647208a13f8ac48e906d4 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/812743069c2647208a13f8ac48e906d4 2023-11-18 20:56:03,742 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 812743069c2647208a13f8ac48e906d4 2023-11-18 20:56:03,743 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 834ec4f43578b93d1d3339afc2c5c47a/family2 of 834ec4f43578b93d1d3339afc2c5c47a into 812743069c2647208a13f8ac48e906d4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:56:03,743 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:56:03,743 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:03,743 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 2f5d9662146329e0b78b585133fa5346/family1 is initiating major compaction (all files) 2023-11-18 20:56:03,744 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:03,744 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:03,744 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 2f5d9662146329e0b78b585133fa5346/family1 in testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:03,744 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp, totalSize=27.1 K 2023-11-18 20:56:03,745 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 961f938ccde94216992aa854f9aa65d1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955223 2023-11-18 20:56:03,745 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1b6cbc4e57594710a41dd62c4b17f8d3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:03,746 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 607896e4d27b452ba41252d950f93823, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:03,746 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 540044c87cd34753860516eaccc4b781, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958943 2023-11-18 20:56:03,746 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting f9911fb57d244f66a39acb61d49d16cc, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:03,755 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 2f5d9662146329e0b78b585133fa5346#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:03,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac] to archive 2023-11-18 20:56:03,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:03,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/d29d180a2f5849c594c7650ed8e80246 2023-11-18 20:56:03,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/dfa0e62ac1f148f190712930fff418fe 2023-11-18 20:56:03,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/f99a325c879c4dea9c384569d15525fa 2023-11-18 20:56:03,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/e843e75a429f476b9e5915c1d29f7d68 2023-11-18 20:56:03,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family2/4e92a0c88cbe4cbe8fbf0c0e6160cbac 2023-11-18 20:56:04,199 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del 2023-11-18 20:56:04,199 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del 2023-11-18 20:56:05,052 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7528c76a62374719bc32188fca6a6987 2023-11-18 20:56:05,053 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family1/7528c76a62374719bc32188fca6a6987 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/7528c76a62374719bc32188fca6a6987 2023-11-18 20:56:05,075 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7528c76a62374719bc32188fca6a6987 2023-11-18 20:56:05,076 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2f5d9662146329e0b78b585133fa5346/family1 of 2f5d9662146329e0b78b585133fa5346 into 7528c76a62374719bc32188fca6a6987(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:56:05,076 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:05,076 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:05,076 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 2f5d9662146329e0b78b585133fa5346/family2 is initiating major compaction (all files) 2023-11-18 20:56:05,076 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:05,076 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:05,077 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 2f5d9662146329e0b78b585133fa5346/family2 in testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:05,077 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp, totalSize=25.4 K 2023-11-18 20:56:05,078 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting a41bd63704d74c858ad89cade885e8e7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955223 2023-11-18 20:56:05,078 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting ccf492a463cf419aa3c4939192bd4cef, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:05,078 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 65437c6b852d4d28aed06a06191e6056, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:05,078 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 563d93afaa124829ae85d3b3e63d0ab4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958943 2023-11-18 20:56:05,079 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting b17517ace39846f29640659fc29c0da5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:05,086 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 2f5d9662146329e0b78b585133fa5346#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:05,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc] to archive 2023-11-18 20:56:05,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:05,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/961f938ccde94216992aa854f9aa65d1 2023-11-18 20:56:05,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/1b6cbc4e57594710a41dd62c4b17f8d3 2023-11-18 20:56:05,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/607896e4d27b452ba41252d950f93823 2023-11-18 20:56:05,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/540044c87cd34753860516eaccc4b781 2023-11-18 20:56:05,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/f9911fb57d244f66a39acb61d49d16cc 2023-11-18 20:56:05,493 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118d4ad57eb16544030a7d321f28597b3e9_del 2023-11-18 20:56:05,494 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231118d4ad57eb16544030a7d321f28597b3e9_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231118d4ad57eb16544030a7d321f28597b3e9_del 2023-11-18 20:56:06,306 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 274e63a1ddab4e3cb79de47e1118897c 2023-11-18 20:56:06,307 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/.tmp/family2/274e63a1ddab4e3cb79de47e1118897c as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/274e63a1ddab4e3cb79de47e1118897c 2023-11-18 20:56:06,310 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 274e63a1ddab4e3cb79de47e1118897c 2023-11-18 20:56:06,311 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2f5d9662146329e0b78b585133fa5346/family2 of 2f5d9662146329e0b78b585133fa5346 into 274e63a1ddab4e3cb79de47e1118897c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:56:06,311 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:06,311 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:06,311 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 6729021eef199c96031f799daa3377bf/family1 is initiating major compaction (all files) 2023-11-18 20:56:06,311 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:06,311 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:06,311 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 6729021eef199c96031f799daa3377bf/family1 in testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:06,312 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp, totalSize=27.1 K 2023-11-18 20:56:06,312 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 8f48b2f8d13e4adc9c65b9ba6d4bcd8d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955224 2023-11-18 20:56:06,312 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting c1da4c711b174b278ff448af5b91b411, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:06,312 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting b9a981b200af484a9e35ef269c61bc92, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:06,313 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 630bc23a49464104a21d0c1ba729f0cd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958944 2023-11-18 20:56:06,313 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 5e4e59c1652744d187d36d41b70073fd, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:06,320 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 6729021eef199c96031f799daa3377bf#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:06,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5] to archive 2023-11-18 20:56:06,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:06,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/a41bd63704d74c858ad89cade885e8e7 2023-11-18 20:56:06,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/ccf492a463cf419aa3c4939192bd4cef 2023-11-18 20:56:06,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/65437c6b852d4d28aed06a06191e6056 2023-11-18 20:56:06,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/563d93afaa124829ae85d3b3e63d0ab4 2023-11-18 20:56:06,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family2/b17517ace39846f29640659fc29c0da5 2023-11-18 20:56:06,757 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del 2023-11-18 20:56:06,757 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del 2023-11-18 20:56:07,610 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efc6437b8654a629e6187d0b47b2054 2023-11-18 20:56:07,611 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family1/5efc6437b8654a629e6187d0b47b2054 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5efc6437b8654a629e6187d0b47b2054 2023-11-18 20:56:07,633 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efc6437b8654a629e6187d0b47b2054 2023-11-18 20:56:07,634 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6729021eef199c96031f799daa3377bf/family1 of 6729021eef199c96031f799daa3377bf into 5efc6437b8654a629e6187d0b47b2054(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-18 20:56:07,634 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:07,634 DEBUG [Listener at localhost/41997] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-18 20:56:07,634 DEBUG [Listener at localhost/41997] regionserver.HStore(1912): 6729021eef199c96031f799daa3377bf/family2 is initiating major compaction (all files) 2023-11-18 20:56:07,634 INFO [Listener at localhost/41997] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-18 20:56:07,634 INFO [Listener at localhost/41997] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-18 20:56:07,635 INFO [Listener at localhost/41997] regionserver.HRegion(2259): Starting compaction of 6729021eef199c96031f799daa3377bf/family2 in testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:07,635 INFO [Listener at localhost/41997] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1] into tmpdir=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp, totalSize=25.4 K 2023-11-18 20:56:07,635 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 15762a4b93fc4a1a827adc986de4a113, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1700340955224 2023-11-18 20:56:07,635 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting a89e2cb3ef554f86b58ee859b3c334dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1700340956332 2023-11-18 20:56:07,636 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 4e1862aac9a347daaa37c7f452956538, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1700340957840 2023-11-18 20:56:07,636 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 1f568f14f1d3424ea8a60e50fc07272d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1700340958944 2023-11-18 20:56:07,637 DEBUG [Listener at localhost/41997] compactions.Compactor(207): Compacting 2b81b711697a4c6398929d5f465740a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-18 20:56:07,645 INFO [Listener at localhost/41997] throttle.PressureAwareThroughputController(145): 6729021eef199c96031f799daa3377bf#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-18 20:56:07,652 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118b854d2fe7034443f9dc837c895ab1ac5_del 2023-11-18 20:56:07,652 INFO [Listener at localhost/41997] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118b854d2fe7034443f9dc837c895ab1ac5_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231118b854d2fe7034443f9dc837c895ab1ac5_del 2023-11-18 20:56:07,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd] to archive 2023-11-18 20:56:07,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:07,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/8f48b2f8d13e4adc9c65b9ba6d4bcd8d 2023-11-18 20:56:07,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/c1da4c711b174b278ff448af5b91b411 2023-11-18 20:56:07,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/b9a981b200af484a9e35ef269c61bc92 2023-11-18 20:56:07,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/630bc23a49464104a21d0c1ba729f0cd 2023-11-18 20:56:07,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/5e4e59c1652744d187d36d41b70073fd 2023-11-18 20:56:08,466 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0acff395d3f24afda9f68d04f2492453 2023-11-18 20:56:08,466 DEBUG [Listener at localhost/41997] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/.tmp/family2/0acff395d3f24afda9f68d04f2492453 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/0acff395d3f24afda9f68d04f2492453 2023-11-18 20:56:08,470 INFO [Listener at localhost/41997] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0acff395d3f24afda9f68d04f2492453 2023-11-18 20:56:08,471 INFO [Listener at localhost/41997] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6729021eef199c96031f799daa3377bf/family2 of 6729021eef199c96031f799daa3377bf into 0acff395d3f24afda9f68d04f2492453(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-18 20:56:08,471 DEBUG [Listener at localhost/41997] regionserver.HRegion(2289): Compaction status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:08,474 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:08,477 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:08,480 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:08,481 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:08,485 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44653] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x91\xE4\xFF\xC8\xB1\x814\xC00\x98\x82M\x0FIp\xE3"\x10\xDA\x1F_\x9D\xED\xEE\xC9\xF6\xBB\xB0n\x05\xB2w\xEB\x16*\x10j\xC4\x80\x06\xD6\xD252Y\xDE\xA4C\x16\xA0\xD0\x962\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-18 20:56:08,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 20:56:08,507 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 20:56:08,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:56:08,508 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1700341568508 2023-11-18 20:56:08,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-18 20:56:08,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1] to archive 2023-11-18 20:56:08,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:08,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/15762a4b93fc4a1a827adc986de4a113 2023-11-18 20:56:08,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/a89e2cb3ef554f86b58ee859b3c334dc 2023-11-18 20:56:08,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/4e1862aac9a347daaa37c7f452956538 2023-11-18 20:56:08,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/1f568f14f1d3424ea8a60e50fc07272d 2023-11-18 20:56:08,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family2/2b81b711697a4c6398929d5f465740a1 2023-11-18 20:56:08,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-18 20:56:08,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del 2023-11-18 20:56:08,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del 2023-11-18 20:56:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del 2023-11-18 20:56:08,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:08,908 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] zookeeper.ReadOnlyZKClient(139): Connect 0x3d5af703 to 127.0.0.1:55479 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-18 20:56:08,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26f15ba3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-18 20:56:08,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:09,463 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111861ed9bf4e0b54ec4bdb4e9709820f92e to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111861ed9bf4e0b54ec4bdb4e9709820f92e 2023-11-18 20:56:09,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:09,475 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-18 20:56:09,478 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-18 20:56:09,485 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-18 20:56:09,487 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-18 20:56:09,514 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/a37218dd4608456fbd60f4dd7c910aec first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-18 20:56:09,515 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/a37218dd4608456fbd60f4dd7c910aec}] 2023-11-18 20:56:09,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/a37218dd4608456fbd60f4dd7c910aec for inclusion in 2f5d9662146329e0b78b585133fa5346/family1 2023-11-18 20:56:09,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-18 20:56:09,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first= last=1 2023-11-18 20:56:09,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:09,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118/family1/a37218dd4608456fbd60f4dd7c910aec to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__5m6ogtp53vhaut6s7p06875pok511qo2j2lbqmghvav3n4uoactktshh6v1e74p/family1/a37218dd4608456fbd60f4dd7c910aec 2023-11-18 20:56:09,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__5m6ogtp53vhaut6s7p06875pok511qo2j2lbqmghvav3n4uoactktshh6v1e74p/family1/a37218dd4608456fbd60f4dd7c910aec as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/25cd1956a7494f96a10d8d8057662186_SeqId_28_ 2023-11-18 20:56:09,544 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__5m6ogtp53vhaut6s7p06875pok511qo2j2lbqmghvav3n4uoactktshh6v1e74p/family1/a37218dd4608456fbd60f4dd7c910aec into 2f5d9662146329e0b78b585133fa5346/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/25cd1956a7494f96a10d8d8057662186_SeqId_28_ - updating store file list. 2023-11-18 20:56:09,565 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/25cd1956a7494f96a10d8d8057662186_SeqId_28_ into 2f5d9662146329e0b78b585133fa5346/family1 2023-11-18 20:56:09,565 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__5m6ogtp53vhaut6s7p06875pok511qo2j2lbqmghvav3n4uoactktshh6v1e74p/family1/a37218dd4608456fbd60f4dd7c910aec into 2f5d9662146329e0b78b585133fa5346/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/family1/25cd1956a7494f96a10d8d8057662186_SeqId_28_) 2023-11-18 20:56:09,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__5m6ogtp53vhaut6s7p06875pok511qo2j2lbqmghvav3n4uoactktshh6v1e74p/family1/a37218dd4608456fbd60f4dd7c910aec 2023-11-18 20:56:09,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:09,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:09,569 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118307ec3ab197545e285fc2ae0bb254846 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118307ec3ab197545e285fc2ae0bb254846 2023-11-18 20:56:09,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111834c384250d5b41249e236a7a03cd1320 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111834c384250d5b41249e236a7a03cd1320 2023-11-18 20:56:09,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111887d32d0ee49b4dcea673a7bfe4363ca1 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111887d32d0ee49b4dcea673a7bfe4363ca1 2023-11-18 20:56:09,572 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ae6cdfffc72f4e75847d217675f0e3fd to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ae6cdfffc72f4e75847d217675f0e3fd 2023-11-18 20:56:09,572 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 20:56:09,572 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231118' 2023-11-18 20:56:09,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:09,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:10,523 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311180385fe56822c4071b5291397dbb440ea to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311180385fe56822c4071b5291397dbb440ea 2023-11-18 20:56:10,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:10,576 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/154dcbf4d11143f7b793918f633bc15a first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-18 20:56:10,577 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/154dcbf4d11143f7b793918f633bc15a}] 2023-11-18 20:56:10,579 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/154dcbf4d11143f7b793918f633bc15a for inclusion in 834ec4f43578b93d1d3339afc2c5c47a/family1 2023-11-18 20:56:10,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-18 20:56:10,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-18 20:56:10,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:56:10,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118/family1/154dcbf4d11143f7b793918f633bc15a to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__hb83rldhoc6jkijfu42s0b74457t5i4hq2r1ohkjl99cc5th8j3dntdpnr0ek605/family1/154dcbf4d11143f7b793918f633bc15a 2023-11-18 20:56:10,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__hb83rldhoc6jkijfu42s0b74457t5i4hq2r1ohkjl99cc5th8j3dntdpnr0ek605/family1/154dcbf4d11143f7b793918f633bc15a as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/60267e2a767847a5897a9a448918f9b8_SeqId_28_ 2023-11-18 20:56:10,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__hb83rldhoc6jkijfu42s0b74457t5i4hq2r1ohkjl99cc5th8j3dntdpnr0ek605/family1/154dcbf4d11143f7b793918f633bc15a into 834ec4f43578b93d1d3339afc2c5c47a/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/60267e2a767847a5897a9a448918f9b8_SeqId_28_ - updating store file list. 2023-11-18 20:56:10,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/60267e2a767847a5897a9a448918f9b8_SeqId_28_ into 834ec4f43578b93d1d3339afc2c5c47a/family1 2023-11-18 20:56:10,624 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__hb83rldhoc6jkijfu42s0b74457t5i4hq2r1ohkjl99cc5th8j3dntdpnr0ek605/family1/154dcbf4d11143f7b793918f633bc15a into 834ec4f43578b93d1d3339afc2c5c47a/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/family1/60267e2a767847a5897a9a448918f9b8_SeqId_28_) 2023-11-18 20:56:10,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__hb83rldhoc6jkijfu42s0b74457t5i4hq2r1ohkjl99cc5th8j3dntdpnr0ek605/family1/154dcbf4d11143f7b793918f633bc15a 2023-11-18 20:56:10,626 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:10,626 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:10,628 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111833fa3c63fa3246d3b4d99a4c2c9ee8fb to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111833fa3c63fa3246d3b4d99a4c2c9ee8fb 2023-11-18 20:56:10,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311184605c7d84b90480d8d920e78854d0b38 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311184605c7d84b90480d8d920e78854d0b38 2023-11-18 20:56:10,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118471c0769c03a453c81be12c1f92e1829 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118471c0769c03a453c81be12c1f92e1829 2023-11-18 20:56:10,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118f66aa9bc88bf4f0e97f06bfe3cbb4860 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118f66aa9bc88bf4f0e97f06bfe3cbb4860 2023-11-18 20:56:10,630 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 20:56:10,630 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231118' 2023-11-18 20:56:10,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:10,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:11,572 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231118cf94c8f0d3814bcba8a5b68f1fc683f9 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118cf94c8f0d3814bcba8a5b68f1fc683f9 2023-11-18 20:56:11,572 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:11,613 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9c7973eb12594c4d9a21f664ac8d1252 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-18 20:56:11,614 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf., hostname=jenkins-hbase4.apache.org,32871,1700340802897, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9c7973eb12594c4d9a21f664ac8d1252}] 2023-11-18 20:56:11,616 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(763): Validating hfile at hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9c7973eb12594c4d9a21f664ac8d1252 for inclusion in 6729021eef199c96031f799daa3377bf/family1 2023-11-18 20:56:11,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-18 20:56:11,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-18 20:56:11,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegion(2446): Flush status journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:11,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118/family1/9c7973eb12594c4d9a21f664ac8d1252 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__d93pj7kh57bad2gs7g7hdn8i8fa2pf746olni0mnbthgdn58j6li20j731k55ecg/family1/9c7973eb12594c4d9a21f664ac8d1252 2023-11-18 20:56:11,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__d93pj7kh57bad2gs7g7hdn8i8fa2pf746olni0mnbthgdn58j6li20j731k55ecg/family1/9c7973eb12594c4d9a21f664ac8d1252 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/3093dbea82904087a8d6865c5bd50518_SeqId_28_ 2023-11-18 20:56:11,639 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(849): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__d93pj7kh57bad2gs7g7hdn8i8fa2pf746olni0mnbthgdn58j6li20j731k55ecg/family1/9c7973eb12594c4d9a21f664ac8d1252 into 6729021eef199c96031f799daa3377bf/family1 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/3093dbea82904087a8d6865c5bd50518_SeqId_28_ - updating store file list. 2023-11-18 20:56:11,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(882): Loaded HFile hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/3093dbea82904087a8d6865c5bd50518_SeqId_28_ into 6729021eef199c96031f799daa3377bf/family1 2023-11-18 20:56:11,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.HStore(855): Successfully loaded hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__d93pj7kh57bad2gs7g7hdn8i8fa2pf746olni0mnbthgdn58j6li20j731k55ecg/family1/9c7973eb12594c4d9a21f664ac8d1252 into 6729021eef199c96031f799daa3377bf/family1 (new location: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/family1/3093dbea82904087a8d6865c5bd50518_SeqId_28_) 2023-11-18 20:56:11,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32871] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/staging/jenkins__testMajorCompactionFromAdmin__d93pj7kh57bad2gs7g7hdn8i8fa2pf746olni0mnbthgdn58j6li20j731k55ecg/family1/9c7973eb12594c4d9a21f664ac8d1252 2023-11-18 20:56:11,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231118 table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:11,662 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:11,663 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183d82a0e3f3114cabb1a7035c1d56ae7d to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183d82a0e3f3114cabb1a7035c1d56ae7d 2023-11-18 20:56:11,664 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183dc0ea1e947f46f48dc46b23c87bd9c2 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311183dc0ea1e947f46f48dc46b23c87bd9c2 2023-11-18 20:56:11,665 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188d28a93ac030451ba33f00e6ffa16e33 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188d28a93ac030451ba33f00e6ffa16e33 2023-11-18 20:56:11,666 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188e2c407a1f9d4b37b544336b5b9b16d7 to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311188e2c407a1f9d4b37b544336b5b9b16d7 2023-11-18 20:56:11,666 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-18 20:56:11,666 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231118' 2023-11-18 20:56:11,666 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231118 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:11,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-18 20:56:11,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-18 20:56:11,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del] 2023-11-18 20:56:11,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:11,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231118ba35092e3a904b8ea71f6e0f5f150738_del 2023-11-18 20:56:11,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 20:56:11,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del] 2023-11-18 20:56:11,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:11,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231118b2fc2fb7e5184ed5aa64241122549daa_del 2023-11-18 20:56:11,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 20:56:11,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del] 2023-11-18 20:56:11,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(360): Archiving compacted files. 2023-11-18 20:56:11,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del to hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231118be196303942f4a68a41a22e0609d8acc_del 2023-11-18 20:56:11,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-18 20:56:11,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1700340806722] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-18 20:56:11,672 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-18 20:56:11,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1660 sec 2023-11-18 20:56:11,693 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:11,694 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:11,697 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-18 20:56:11,697 DEBUG [Listener at localhost/41997] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-18 20:56:11,701 INFO [Listener at localhost/41997] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-18 20:56:11,735 INFO [Listener at localhost/41997] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=249 (was 264), OpenFileDescriptor=670 (was 694), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=130 (was 129) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 171), AvailableMemoryMB=20762 (was 20761) - AvailableMemoryMB LEAK? - 2023-11-18 20:56:11,735 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7faa020d to 127.0.0.1:55479 2023-11-18 20:56:11,735 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:11,736 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-18 20:56:11,736 INFO [Listener at localhost/41997] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-18 20:56:11,736 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2a962e to 127.0.0.1:55479 2023-11-18 20:56:11,736 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:11,736 DEBUG [Listener at localhost/41997] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-18 20:56:11,736 DEBUG [Listener at localhost/41997] util.JVMClusterUtil(257): Found active master hash=756289219, stopped=false 2023-11-18 20:56:11,736 INFO [Listener at localhost/41997] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:56:11,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-18 20:56:11,738 INFO [Listener at localhost/41997] procedure2.ProcedureExecutor(628): Stopping 2023-11-18 20:56:11,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:56:11,738 DEBUG [Listener at localhost/41997] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78df465a to 127.0.0.1:55479 2023-11-18 20:56:11,738 DEBUG [Listener at localhost/41997] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:11,738 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-18 20:56:11,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 20:56:11,738 INFO [Listener at localhost/41997] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32871,1700340802897' ***** 2023-11-18 20:56:11,739 INFO [Listener at localhost/41997] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-18 20:56:11,739 INFO [RS:0;jenkins-hbase4:32871] regionserver.HeapMemoryManager(220): Stopping 2023-11-18 20:56:11,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-18 20:56:11,739 INFO [RS:0;jenkins-hbase4:32871] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-18 20:56:11,739 INFO [RS:0;jenkins-hbase4:32871] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-18 20:56:11,739 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-18 20:56:11,739 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for c8a50b8965738f174a5cd6c2d8fd9f7c 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 834ec4f43578b93d1d3339afc2c5c47a 2023-11-18 20:56:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c8a50b8965738f174a5cd6c2d8fd9f7c, disabling compactions & flushes 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for f70073fffac2630f2590dc0cc876d983 2023-11-18 20:56:11,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 98730234eadd8cd0ebb305eddccd523b 2023-11-18 20:56:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for c08b8b8fa298f5c4abff74bf4bf6363c 2023-11-18 20:56:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. after waiting 0 ms 2023-11-18 20:56:11,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 5ef39e57a773de83a770fde093696751 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 4308691617d157c7aa4b029ae95cc8d1 2023-11-18 20:56:11,740 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 0b7c545d2c54a566d30189d31a7147f1 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 88111fc5afdd533d61a509691718eaba 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 2f5d9662146329e0b78b585133fa5346 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for a58f913bb6e2f707eed0b258698334cc 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 0818667696a0f9030b3b6acc9f576231 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for d737c5e6ff00cde1f3ca73b85b854a29 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for c4e6661d8c3acc1ec607c852cb095d88 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 1e6988a556cb073a80193c0ff852e78c 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 8fd816d89d9c312b32b8483945fec8e6 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for dbb912a5b612e2ba3e6bd669ef8c1b88 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 44802116890a24c27ebbbeb23abd6339 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 6729021eef199c96031f799daa3377bf 2023-11-18 20:56:11,741 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:11,741 DEBUG [RS:0;jenkins-hbase4:32871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2666dfa2 to 127.0.0.1:55479 2023-11-18 20:56:11,741 DEBUG [RS:0;jenkins-hbase4:32871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:11,742 INFO [RS:0;jenkins-hbase4:32871] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-18 20:56:11,742 INFO [RS:0;jenkins-hbase4:32871] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-18 20:56:11,742 INFO [RS:0;jenkins-hbase4:32871] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-18 20:56:11,742 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-18 20:56:11,742 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-18 20:56:11,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-18 20:56:11,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-18 20:56:11,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-18 20:56:11,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-18 20:56:11,742 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-18 20:56:11,742 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-18 20:56:11,743 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1504): Waiting on 0818667696a0f9030b3b6acc9f576231, 0b7c545d2c54a566d30189d31a7147f1, 1588230740, 1e6988a556cb073a80193c0ff852e78c, 2f5d9662146329e0b78b585133fa5346, 4308691617d157c7aa4b029ae95cc8d1, 44802116890a24c27ebbbeb23abd6339, 5ef39e57a773de83a770fde093696751, 6729021eef199c96031f799daa3377bf, 834ec4f43578b93d1d3339afc2c5c47a, 88111fc5afdd533d61a509691718eaba, 8fd816d89d9c312b32b8483945fec8e6, 98730234eadd8cd0ebb305eddccd523b, a58f913bb6e2f707eed0b258698334cc, c08b8b8fa298f5c4abff74bf4bf6363c, c4e6661d8c3acc1ec607c852cb095d88, c8a50b8965738f174a5cd6c2d8fd9f7c, d737c5e6ff00cde1f3ca73b85b854a29, dbb912a5b612e2ba3e6bd669ef8c1b88, f5b54a9ca2bc73b4fe66796d83446d01, f70073fffac2630f2590dc0cc876d983 2023-11-18 20:56:11,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithMonthlyPolicy/c8a50b8965738f174a5cd6c2d8fd9f7c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-18 20:56:11,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:56:11,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c8a50b8965738f174a5cd6c2d8fd9f7c: 2023-11-18 20:56:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1700340818951.c8a50b8965738f174a5cd6c2d8fd9f7c. 2023-11-18 20:56:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 834ec4f43578b93d1d3339afc2c5c47a, disabling compactions & flushes 2023-11-18 20:56:11,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. after waiting 0 ms 2023-11-18 20:56:11,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:11,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/834ec4f43578b93d1d3339afc2c5c47a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:11,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:11,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 834ec4f43578b93d1d3339afc2c5c47a: 2023-11-18 20:56:11,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1700340953080.834ec4f43578b93d1d3339afc2c5c47a. 2023-11-18 20:56:11,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f70073fffac2630f2590dc0cc876d983, disabling compactions & flushes 2023-11-18 20:56:11,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:56:11,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:56:11,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. after waiting 0 ms 2023-11-18 20:56:11,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:56:11,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/f70073fffac2630f2590dc0cc876d983/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:11,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:56:11,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f70073fffac2630f2590dc0cc876d983: 2023-11-18 20:56:11,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1700340921681.f70073fffac2630f2590dc0cc876d983. 2023-11-18 20:56:11,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 98730234eadd8cd0ebb305eddccd523b, disabling compactions & flushes 2023-11-18 20:56:11,761 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:56:11,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:56:11,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. after waiting 0 ms 2023-11-18 20:56:11,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:56:11,761 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-18 20:56:11,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/98730234eadd8cd0ebb305eddccd523b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-18 20:56:11,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 98730234eadd8cd0ebb305eddccd523b: 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1700340806874.98730234eadd8cd0ebb305eddccd523b. 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c08b8b8fa298f5c4abff74bf4bf6363c, disabling compactions & flushes 2023-11-18 20:56:11,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. after waiting 0 ms 2023-11-18 20:56:11,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:56:11,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/c08b8b8fa298f5c4abff74bf4bf6363c/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-18 20:56:11,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c08b8b8fa298f5c4abff74bf4bf6363c: 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1700340877236.c08b8b8fa298f5c4abff74bf4bf6363c. 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5ef39e57a773de83a770fde093696751, disabling compactions & flushes 2023-11-18 20:56:11,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. after waiting 0 ms 2023-11-18 20:56:11,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:56:11,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/5ef39e57a773de83a770fde093696751/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:11,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5ef39e57a773de83a770fde093696751: 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1700340921681.5ef39e57a773de83a770fde093696751. 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4308691617d157c7aa4b029ae95cc8d1, disabling compactions & flushes 2023-11-18 20:56:11,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. after waiting 0 ms 2023-11-18 20:56:11,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:56:11,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/4308691617d157c7aa4b029ae95cc8d1/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-18 20:56:11,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4308691617d157c7aa4b029ae95cc8d1: 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1700340843175.4308691617d157c7aa4b029ae95cc8d1. 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0b7c545d2c54a566d30189d31a7147f1, disabling compactions & flushes 2023-11-18 20:56:11,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. after waiting 0 ms 2023-11-18 20:56:11,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:56:11,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0b7c545d2c54a566d30189d31a7147f1 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-18 20:56:11,836 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-18 20:56:11,943 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1504): Waiting on 0818667696a0f9030b3b6acc9f576231, 0b7c545d2c54a566d30189d31a7147f1, 1588230740, 1e6988a556cb073a80193c0ff852e78c, 2f5d9662146329e0b78b585133fa5346, 44802116890a24c27ebbbeb23abd6339, 6729021eef199c96031f799daa3377bf, 88111fc5afdd533d61a509691718eaba, 8fd816d89d9c312b32b8483945fec8e6, a58f913bb6e2f707eed0b258698334cc, c4e6661d8c3acc1ec607c852cb095d88, d737c5e6ff00cde1f3ca73b85b854a29, dbb912a5b612e2ba3e6bd669ef8c1b88, f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:56:12,143 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1504): Waiting on 0818667696a0f9030b3b6acc9f576231, 0b7c545d2c54a566d30189d31a7147f1, 1588230740, 1e6988a556cb073a80193c0ff852e78c, 2f5d9662146329e0b78b585133fa5346, 44802116890a24c27ebbbeb23abd6339, 6729021eef199c96031f799daa3377bf, 88111fc5afdd533d61a509691718eaba, 8fd816d89d9c312b32b8483945fec8e6, a58f913bb6e2f707eed0b258698334cc, c4e6661d8c3acc1ec607c852cb095d88, d737c5e6ff00cde1f3ca73b85b854a29, dbb912a5b612e2ba3e6bd669ef8c1b88, f5b54a9ca2bc73b4fe66796d83446d01 2023-11-18 20:56:12,154 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/info/e9a687db1cd8410eb20cd21708991d52 2023-11-18 20:56:12,158 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9a687db1cd8410eb20cd21708991d52 2023-11-18 20:56:12,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/.tmp/info/00a5479019684e12bd27d1ebb8dbbb10 2023-11-18 20:56:12,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/.tmp/info/00a5479019684e12bd27d1ebb8dbbb10 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/info/00a5479019684e12bd27d1ebb8dbbb10 2023-11-18 20:56:12,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/info/00a5479019684e12bd27d1ebb8dbbb10, entries=3, sequenceid=7, filesize=4.8 K 2023-11-18 20:56:12,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 0b7c545d2c54a566d30189d31a7147f1 in 416ms, sequenceid=7, compaction requested=false 2023-11-18 20:56:12,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/namespace/0b7c545d2c54a566d30189d31a7147f1/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-18 20:56:12,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0b7c545d2c54a566d30189d31a7147f1: 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1700340805302.0b7c545d2c54a566d30189d31a7147f1. 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88111fc5afdd533d61a509691718eaba, disabling compactions & flushes 2023-11-18 20:56:12,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. after waiting 0 ms 2023-11-18 20:56:12,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:56:12,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/88111fc5afdd533d61a509691718eaba/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-18 20:56:12,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88111fc5afdd533d61a509691718eaba: 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1700340843175.88111fc5afdd533d61a509691718eaba. 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f5b54a9ca2bc73b4fe66796d83446d01, disabling compactions & flushes 2023-11-18 20:56:12,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. after waiting 0 ms 2023-11-18 20:56:12,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:56:12,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/f5b54a9ca2bc73b4fe66796d83446d01/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 20:56:12,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f5b54a9ca2bc73b4fe66796d83446d01: 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1700340897787.f5b54a9ca2bc73b4fe66796d83446d01. 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f5d9662146329e0b78b585133fa5346, disabling compactions & flushes 2023-11-18 20:56:12,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. after waiting 0 ms 2023-11-18 20:56:12,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:12,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/2f5d9662146329e0b78b585133fa5346/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:12,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f5d9662146329e0b78b585133fa5346: 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1700340953080.2f5d9662146329e0b78b585133fa5346. 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a58f913bb6e2f707eed0b258698334cc, disabling compactions & flushes 2023-11-18 20:56:12,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. after waiting 0 ms 2023-11-18 20:56:12,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:56:12,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/a58f913bb6e2f707eed0b258698334cc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 20:56:12,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a58f913bb6e2f707eed0b258698334cc: 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1700340897787.a58f913bb6e2f707eed0b258698334cc. 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0818667696a0f9030b3b6acc9f576231, disabling compactions & flushes 2023-11-18 20:56:12,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. after waiting 0 ms 2023-11-18 20:56:12,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:56:12,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/0818667696a0f9030b3b6acc9f576231/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-18 20:56:12,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0818667696a0f9030b3b6acc9f576231: 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1700340861048.0818667696a0f9030b3b6acc9f576231. 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d737c5e6ff00cde1f3ca73b85b854a29, disabling compactions & flushes 2023-11-18 20:56:12,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. after waiting 0 ms 2023-11-18 20:56:12,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:56:12,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithWeeklyPolicy/d737c5e6ff00cde1f3ca73b85b854a29/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 20:56:12,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d737c5e6ff00cde1f3ca73b85b854a29: 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1700340831093.d737c5e6ff00cde1f3ca73b85b854a29. 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c4e6661d8c3acc1ec607c852cb095d88, disabling compactions & flushes 2023-11-18 20:56:12,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. after waiting 0 ms 2023-11-18 20:56:12,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/ns/testMinorCompaction/c4e6661d8c3acc1ec607c852cb095d88/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:12,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c4e6661d8c3acc1ec607c852cb095d88: 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1700340921681.c4e6661d8c3acc1ec607c852cb095d88. 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e6988a556cb073a80193c0ff852e78c, disabling compactions & flushes 2023-11-18 20:56:12,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. after waiting 0 ms 2023-11-18 20:56:12,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMinorCompactionWithMonthlyPolicy/1e6988a556cb073a80193c0ff852e78c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-18 20:56:12,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e6988a556cb073a80193c0ff852e78c: 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1700340940063.1e6988a556cb073a80193c0ff852e78c. 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fd816d89d9c312b32b8483945fec8e6, disabling compactions & flushes 2023-11-18 20:56:12,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. after waiting 0 ms 2023-11-18 20:56:12,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:56:12,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionWithWeeklyPolicy/8fd816d89d9c312b32b8483945fec8e6/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-18 20:56:12,234 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fd816d89d9c312b32b8483945fec8e6: 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1700340848163.8fd816d89d9c312b32b8483945fec8e6. 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbb912a5b612e2ba3e6bd669ef8c1b88, disabling compactions & flushes 2023-11-18 20:56:12,235 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. after waiting 0 ms 2023-11-18 20:56:12,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:56:12,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testCompactionWithHFileLink/dbb912a5b612e2ba3e6bd669ef8c1b88/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-18 20:56:12,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbb912a5b612e2ba3e6bd669ef8c1b88: 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1700340897787.dbb912a5b612e2ba3e6bd669ef8c1b88. 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44802116890a24c27ebbbeb23abd6339, disabling compactions & flushes 2023-11-18 20:56:12,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. after waiting 0 ms 2023-11-18 20:56:12,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:56:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testScannerOnBulkLoadRefHFiles/44802116890a24c27ebbbeb23abd6339/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-18 20:56:12,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:56:12,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44802116890a24c27ebbbeb23abd6339: 2023-11-18 20:56:12,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1700340843175.44802116890a24c27ebbbeb23abd6339. 2023-11-18 20:56:12,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6729021eef199c96031f799daa3377bf, disabling compactions & flushes 2023-11-18 20:56:12,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:12,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:12,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. after waiting 0 ms 2023-11-18 20:56:12,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:12,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/default/testMajorCompactionFromAdmin/6729021eef199c96031f799daa3377bf/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-18 20:56:12,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:12,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6729021eef199c96031f799daa3377bf: 2023-11-18 20:56:12,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1700340953080.6729021eef199c96031f799daa3377bf. 2023-11-18 20:56:12,343 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-18 20:56:12,544 DEBUG [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-18 20:56:12,566 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/rep_barrier/37d45eafd8c74102bd0f9f92450fd150 2023-11-18 20:56:12,571 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37d45eafd8c74102bd0f9f92450fd150 2023-11-18 20:56:12,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/table/5c0bd02a8aa244ffb3d9929a89230802 2023-11-18 20:56:12,580 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c0bd02a8aa244ffb3d9929a89230802 2023-11-18 20:56:12,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/info/e9a687db1cd8410eb20cd21708991d52 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/info/e9a687db1cd8410eb20cd21708991d52 2023-11-18 20:56:12,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9a687db1cd8410eb20cd21708991d52 2023-11-18 20:56:12,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/info/e9a687db1cd8410eb20cd21708991d52, entries=226, sequenceid=130, filesize=37.9 K 2023-11-18 20:56:12,585 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/rep_barrier/37d45eafd8c74102bd0f9f92450fd150 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/rep_barrier/37d45eafd8c74102bd0f9f92450fd150 2023-11-18 20:56:12,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 37d45eafd8c74102bd0f9f92450fd150 2023-11-18 20:56:12,588 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/rep_barrier/37d45eafd8c74102bd0f9f92450fd150, entries=1, sequenceid=130, filesize=5.0 K 2023-11-18 20:56:12,588 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/.tmp/table/5c0bd02a8aa244ffb3d9929a89230802 as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/table/5c0bd02a8aa244ffb3d9929a89230802 2023-11-18 20:56:12,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5c0bd02a8aa244ffb3d9929a89230802 2023-11-18 20:56:12,591 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/table/5c0bd02a8aa244ffb3d9929a89230802, entries=27, sequenceid=130, filesize=6.6 K 2023-11-18 20:56:12,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 851ms, sequenceid=130, compaction requested=false 2023-11-18 20:56:12,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-18 20:56:12,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-18 20:56:12,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-18 20:56:12,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-18 20:56:12,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-18 20:56:12,689 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-18 20:56:12,689 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-18 20:56:12,744 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32871,1700340802897; all regions closed. 2023-11-18 20:56:12,751 DEBUG [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/oldWALs 2023-11-18 20:56:12,751 INFO [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32871%2C1700340802897.meta:.meta(num 1700340805028) 2023-11-18 20:56:12,755 DEBUG [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/oldWALs 2023-11-18 20:56:12,755 INFO [RS:0;jenkins-hbase4:32871] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32871%2C1700340802897:(num 1700340804812) 2023-11-18 20:56:12,755 DEBUG [RS:0;jenkins-hbase4:32871] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:12,755 INFO [RS:0;jenkins-hbase4:32871] regionserver.LeaseManager(133): Closed leases 2023-11-18 20:56:12,756 INFO [RS:0;jenkins-hbase4:32871] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-18 20:56:12,756 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-18 20:56:12,757 INFO [RS:0;jenkins-hbase4:32871] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32871 2023-11-18 20:56:12,765 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32871,1700340802897 2023-11-18 20:56:12,765 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 20:56:12,765 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-18 20:56:12,768 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32871,1700340802897] 2023-11-18 20:56:12,768 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32871,1700340802897; numProcessing=1 2023-11-18 20:56:12,769 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32871,1700340802897 already deleted, retry=false 2023-11-18 20:56:12,769 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,32871,1700340802897 expired; onlineServers=0 2023-11-18 20:56:12,769 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,44653,1700340801652' ***** 2023-11-18 20:56:12,769 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-18 20:56:12,770 DEBUG [M:0;jenkins-hbase4:44653] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c2904f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-18 20:56:12,770 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,44653,1700340801652 2023-11-18 20:56:12,770 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,44653,1700340801652; all regions closed. 2023-11-18 20:56:12,770 DEBUG [M:0;jenkins-hbase4:44653] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-18 20:56:12,770 DEBUG [M:0;jenkins-hbase4:44653] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-18 20:56:12,770 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-18 20:56:12,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700340804498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1700340804498,5,FailOnTimeoutGroup] 2023-11-18 20:56:12,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700340804498] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1700340804498,5,FailOnTimeoutGroup] 2023-11-18 20:56:12,770 DEBUG [M:0;jenkins-hbase4:44653] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-18 20:56:12,770 INFO [M:0;jenkins-hbase4:44653] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-18 20:56:12,770 INFO [M:0;jenkins-hbase4:44653] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-18 20:56:12,771 INFO [M:0;jenkins-hbase4:44653] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-18 20:56:12,771 DEBUG [M:0;jenkins-hbase4:44653] master.HMaster(1512): Stopping service threads 2023-11-18 20:56:12,771 INFO [M:0;jenkins-hbase4:44653] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-18 20:56:12,771 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-18 20:56:12,771 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-18 20:56:12,771 ERROR [M:0;jenkins-hbase4:44653] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-18 20:56:12,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-18 20:56:12,772 INFO [M:0;jenkins-hbase4:44653] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-18 20:56:12,772 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-18 20:56:12,772 DEBUG [M:0;jenkins-hbase4:44653] zookeeper.ZKUtil(398): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-18 20:56:12,772 WARN [M:0;jenkins-hbase4:44653] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-18 20:56:12,772 INFO [M:0;jenkins-hbase4:44653] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-18 20:56:12,772 INFO [M:0;jenkins-hbase4:44653] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-18 20:56:12,773 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-18 20:56:12,773 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:56:12,773 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:56:12,773 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-18 20:56:12,773 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:56:12,773 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.93 KB heapSize=599.15 KB 2023-11-18 20:56:12,781 INFO [M:0;jenkins-hbase4:44653] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.93 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f8d4b7ca429942949722f109885adc9b 2023-11-18 20:56:12,784 INFO [M:0;jenkins-hbase4:44653] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8d4b7ca429942949722f109885adc9b 2023-11-18 20:56:12,785 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f8d4b7ca429942949722f109885adc9b as hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f8d4b7ca429942949722f109885adc9b 2023-11-18 20:56:12,788 INFO [M:0;jenkins-hbase4:44653] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8d4b7ca429942949722f109885adc9b 2023-11-18 20:56:12,788 INFO [M:0;jenkins-hbase4:44653] regionserver.HStore(1080): Added hdfs://localhost:41799/user/jenkins/test-data/574f561d-0bd5-28af-8f19-bfdf36af6d1e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f8d4b7ca429942949722f109885adc9b, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-18 20:56:12,788 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegion(2948): Finished flush of dataSize ~512.93 KB/525242, heapSize ~599.13 KB/613512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 15ms, sequenceid=1011, compaction requested=false 2023-11-18 20:56:12,789 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-18 20:56:12,789 DEBUG [M:0;jenkins-hbase4:44653] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-18 20:56:12,798 INFO [M:0;jenkins-hbase4:44653] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-18 20:56:12,798 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-18 20:56:12,798 INFO [M:0;jenkins-hbase4:44653] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44653 2023-11-18 20:56:12,801 DEBUG [M:0;jenkins-hbase4:44653] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44653,1700340801652 already deleted, retry=false 2023-11-18 20:56:12,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 20:56:12,868 INFO [RS:0;jenkins-hbase4:32871] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32871,1700340802897; zookeeper connection closed. 2023-11-18 20:56:12,868 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): regionserver:32871-0x1000245812a0001, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 20:56:12,868 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5587f05a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5587f05a 2023-11-18 20:56:12,869 INFO [Listener at localhost/41997] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-18 20:56:12,903 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 20:56:12,904 DEBUG [Listener at localhost/41997-EventThread] zookeeper.ZKWatcher(600): master:44653-0x1000245812a0000, quorum=127.0.0.1:55479, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-18 20:56:12,903 INFO [M:0;jenkins-hbase4:44653] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,44653,1700340801652; zookeeper connection closed. 2023-11-18 20:56:12,905 WARN [Listener at localhost/41997] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-18 20:56:12,909 INFO [Listener at localhost/41997] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-18 20:56:13,015 WARN [BP-716673243-172.31.14.131-1700340798252 heartbeating to localhost/127.0.0.1:41799] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-18 20:56:13,015 WARN [BP-716673243-172.31.14.131-1700340798252 heartbeating to localhost/127.0.0.1:41799] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-716673243-172.31.14.131-1700340798252 (Datanode Uuid 0aa0e251-94b9-402c-97e6-75e64db04731) service to localhost/127.0.0.1:41799 2023-11-18 20:56:13,017 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/dfs/data/data1/current/BP-716673243-172.31.14.131-1700340798252] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-18 20:56:13,018 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/fd7abbc3-cde3-6509-20d6-93c8e50e07ec/cluster_1d6a4e2e-39bc-4da8-5607-0f10714c3261/dfs/data/data2/current/BP-716673243-172.31.14.131-1700340798252] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-18 20:56:13,046 INFO [Listener at localhost/41997] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-18 20:56:13,190 INFO [Listener at localhost/41997] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-18 20:56:13,268 INFO [Listener at localhost/41997] hbase.HBaseTestingUtility(1293): Minicluster is down